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EXECUTIVE  SUMMARY 


This  Test  and  Evaluation  Master  Plan  (TEMP)  addresses  the  Test  and  Evaluation  (T&E) 
requirements  associated  with  the  acquisition  and  deployment  of  the  Weather  Systems  Processor 
(WSP).  This  document  will  be  referenced  by  the  Integrated  Program  Plan  (IPP)  for  the  WSP. 
The  WSP  Integrated  Product  Team  (IPT)  will  seek  approval  of  the  IPP  from  the  acquisition 
executive  early  in  the  solution  implementation  phase  and  before  release  of  any  formal  solicitation, 
transfer  of  funds,  or  commitment  to  any  interagency  agreement  for  the  WSP  program 
implementation. 

The  purpose  of  this  WSP  TEMP  is  to  describe  technical  and  operational  testing  requirements, 
general  methodology,  and  responsibilities  for  the  comprehensive  system  testing  of  the  WSP 
National  Airspace  System  (NAS)  subsystem.  This  TEMP  establishes  an  agreement  between  the 
developing  organization,  the  user,  and  the  tester  to  support  acquisition  decisions  by  identifying 
areas  of  technical  and  operational  risk,  by  defining  a  comprehensive  plan  to  address  and  resolve 
the  risk,  and  to  provide  a  structure  for  reporting  the  results  in  an  objective  and  unbiased  manner. 


1.  INTRODUCTION. 


This  Test  and  Evaluation  Master  Plan  (TEMP)  is  developed  in  accordance  with  the  Federal 
Aviation  Administration  (FAA)  Acquisition  Management  System  (AMS),  dated  April  1,  1996. 

As  the  FAA  AMS  direction  on  Test  and  Evaluation  (T&E)  policy  is  still  in  the  evolutionary  stage, 
this  document  comes  under  the  direction  of  Acquisition  Reform  Interim  Guidance  (ARIG);  96-1, 
dated  July  10,  1996.  The  contents  and  format  of  this  TEMP  comply  with  the  guidelines  and 
requirements  defined  in  FAA  Order  1810.4B,  FAA  National  Airspace  System  (NAS)  Test  and 
Evaluation  Policy,  dated  October  22,  1992  and  FAA-STD-024B,  Content  and  Format 
Requirements  for  the  Preparation  of  T&E  Documentation,  dated  August  22,  1994.  This  TEMP  is 
a  living  document  and  may  be  updated  to  reflect  major  system  changes  at  the  discretion  of  the 
Wind  Shear  Product  Team  (PT). 

This  TEMP  addresses  the  T&E  requirements  associated  with  the  acquisition  and  deployment  for 
the  Weather  Systems  Processor  (WSP).  The  Product  Team  has  concurred  with  this  document 
and  it  will  be  referenced  by  the  Integrated  Program  Plan  (IPP)  for  the  WSP.  The  WSP  Integrated 
Product  Team  (IPT)  will  seek  approval  of  the  IPP  from  the  acquisition  executive  early  in  the 
solution  implementation  phase  and  before  release  of  any  formal  solicitation,  transfer  of  funds,  or 
commitment  to  any  interagency  agreement  for  the  WSP  program  implementation.  Draft 
solicitations  may  be  released  for  industry  review  and  comment  before  approval  of  the  IPP. 

1.1  BACKGROUND. 

Since  1986,  the  Airport  Surveillance  Radar  (ASR)  Program  Office  has  funded  the  Massachusetts 
Institute  of  Technology/Lincoln  Laboratory  (MIT/LL)  to  evaluate  the  low-altitude  wind  shear 
detection  capabilities  (microburst  and  gust  fronts)  of  the  WSP.  This  capability  will  be  achieved  by 
means  of  a  relatively  low  cost  modification  to  the  ASRs  which  will  allow  the  detection  of  low- 
altitude  wind  shear  without  interfering  with  the  primary  function  of  aircraft  detection  and 
tracking. 

A  WSP  test  bed  was  established  and  operated  in  Huntsville,  Alabama,  in  1987,  and  continued 
through  1988.  In  order  to  investigate  algorithmic  performance  under  diverse  weather  conditions, 
the  test  bed  was  moved  to  Kansas  City,  Missouri  in  1989,  and  from  1990  to  1992,  the  test  bed 
was  operated  in  Orlando,  Florida.  During  the  Orlando  field  program,  the  test  bed  ASR-8  was 
replaced  by  a  production  ASR-9,  and  an  operational  demonstration  of  the  prototype  WSP 
weather  products  in  the  Orlando  Air  Traffic  Control  (ATC)  facilities  commenced.  Since  1993, 
the  test  bed  has  been  located  in  Albuquerque,  New  Mexico,  in  order  to  support  the  refinement  of 
algorithms  for  operation  in  an  environment  known  for  frequent  "dry"  wind  shear  activity. 

MIT/LL  is  currently  conducting  prototype  testing  Demonstration  Validation  (DEMVAL)  to 
demonstrate  that  WSP  interfaces  to  the  ASR-9  do  not  adversely  affect  surveillance  radar 
performance.  MIT/LL,  working  under  a  study  contract  with  Northrop  Grumman,  will  design, 
develop,  and  demonstrate  a  new  high  integrity  receiver  chain,  a  hardware/software  interface  for 
ASR-9  6-level  weather,  and  a  Remote  Monitoring  Infrastructure  and  man-machine  interface. 
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The  WSP  will  detect  and  display  hazardous  weather  phenomena,  in  particular,  low-altitude  wind 
shear  created  by  thunderstorm-generated  microbursts  and  gust  fronts.  Coverage  will  be  provided 
to  airports  not  slated  for  a  dedicated  Terminal  Doppler  Weather  Radar  (TDWR).  The  WSP  will 
expand  and  improve  the  ability  to  provide  warning  of  terminal  area  hazardous  wind  shear, 
microburst,  and  wind  shift,  and  improve  the  display  and  tracking  of  thunderstorms. 

The  WSP  procurement  is  at  the  Investment  Decision.  A  key  WSP  acquisition  objective  is  to 
implement  low-cost,  high  quality,  wind  shear  detection  equipment  at  medium  and  high  air  traffic 
density  airports  not  equipped  with  TDWR.  The  WSP  provides  advanced  Doppler  weather  radar 
performance,  including  all  the  functions  of  the  TDWR,  along  with  several  planned  improvements 
to  the  TDWR  from  the  planned  Integrated  Terminal  Weather  System  (ITWS). 


Because  of  the  specialized  functions  performed  by  the  WSP  there  are  as  of  this  writing  no  known 
complete  Commercial-off-the-Shelf  (COTS)  systems  that  satisfy  the  WSP  Mission  Need 
Statement  (MNS).  The  WSP  prototype  was  developed  using  COTS  hardware  and  Non- 
Developmental  Item  (NDI)  components  from  the  ASR-9  and  the  TDWR.  It  is  anticipated  that  the 
development  contractor  will  utilize  as  many  COTS  and  NDI  hardware  items  as  possible.  The 
meteorological  algorithms  will  be  provided  to  the  contractor  as  government  furnished  property 
(GFP) 

This  project  is  not  designated  for  Independent  Operational  Test  and  Evaluation  Oversight 
(lOT&E). 

12  PURPOSE. 

The  purpose  of  this  WSP  TEMP  is  to  describe  technical  and  operational  testing  requirements, 
general  methodology,  and  responsibilities  for  the  comprehensive  system  testing  of  the  WSP  NAS 
subsystem.  This  TEMP  establishes  an  agreement  between  the  developing  organization,  the  user, 
and  the  tester  to  support  acquisition  decisions  by  identifying  areas  of  technical  and  operational 
risk,  by  defining  a  comprehensive  plan  to  address  and  resolve  the  risk,  and  to  provide  a  structure 
for  reporting  the  results  in  an  objective  and  unbiased  manner. 

These  T&E  activities  include: 

a.  Overall  test  strategy  presentation, 

b.  Technical  and  operational  risk  identification, 

c.  Test  requirements  and  critical  T&E  issues  identification, 

d.  Test  responsibilities  and  implementation  identification,  and 

e.  Development  of  T&E  schedules 
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1.3  SCOPE 


This  TEMP  will  detail  the  T«&E  strategy  as  applicable  to  the  development,  production,  and 
deployment  of  the  WSP.  The  T&E  program  philosophy  is  to  ensure  that  all  of  the  specified 
requirements  for  the  WSP,  including  reliability,  availability  and  maintainability,  have  been 
satisfied,  and  that  the  WSP  is  operationally  suitable  in  the  ATC  environment. 

The  test  and  evaluation  of  the  WSP,  hereafter  referred  to  as  System  Test,  will  provide  verification 
that  the  WSP  fulfills  the  Mission  Need  Statement,  meets  the  requirements  contained  in  the  WSP 
Requirements  Document  (RD)  and  System  Specification,  and  operates  effectively  when  integrated 
into  the  NAS.  The  WSP  Verification  Requirements  Traceability  Matrix  (VRTM)  identifies  the 
verification  method  and  is  contained  in  section  appendix  A  of  this  document.  System  Testing  will 
confirm  that  test  and  evaluation  as  required  by  FAA  Order  1 8 10.4B  has  been  completed.  System 
Test  will  be  conducted  on  developmental  systems,  COTS  and  NDI  systems,  and  significant  Pre- 
Planned  Product  Improvements  (P’l)  that  change  a  baselined  system.  As  of  this  writing. 

Terminal  Weather  Information  for  Pilots  (TWIP)  is  considered  a  P’l  for  the  WSP.  The 
implementation  and  testing  of  TWIP  will  be  addressed  in  the  WSP  OT&E  test  plan  when  that 
requirement  is  identified.  Figure  1.3-1  depicts  a  high  level  flow  of  System  Testing  . 


investment  Decision 


Contract  Award 


Production  Decision 
or  lOTRD 


FIGURE  1.3-1.  WSP  SYSTEM  TEST  BLOCK  DIAGRAM 


The  WSP  Acquisition  Strategy  Paper  (ASP)  provides  for  the  procurement  of  the  limited 
production  of  seven  first  article  units  at  the  Investment  Decision.  Provisions  will  be  made  for  the 
procurement  of  the  production  turnkey  units  at  the  Production  Decision.  Of  the  seven  limited 
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production  units,  the  first  five  will  be  considered  “prototype”  systems  and  the  remaining  two  will 
be  considered  “first  article”  systems.  The  first  of  these  “prototype”  systems  will  remain  at  the 
contractor’s  facility  for  factory  testing.  The  second  “prototype”  system  will  be  shipped  to  the 
FAA  William  J.  Hughes  Technical  Center  in  Atlantic  City,  New  Jersey,  for  government  test  and 
evaluation.  Subsequent  “prototype”  systems  will  be  shipped  to  selected  ASR-9  key  sites  and  will 
be  operated  under  a  test  NAS  Change  Proposal  (NCP).  The  two  “first  article”  systems  will  be 
installed  at  selected  sites.  At  this  time,  the  “prototype”  systems  will  be  brought  up  to  “first 
article”  configuration. 

Subsequent  to  successful  government  testing,  the  FAA  will  award  a  production  contract  for  up  to 
40  WSP  systems  including  retrofit  kits  necessary  to  bring  limited  production  systems  up  to  final 
production  configuration. 
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2.  REFERENCE  DOCUMENTS. 


The  following  specifications,  standards,  publications,  orders,  and  other  miscellaneous  documents 
were  used  in  preparation  of  this  document  and  may  be  utilized  in  the  preparation  of  subsequent 
lower  level  test  documents  and  test  reports. 

FAA  DOCUMENTS 


FAA  Specifications 
NAS-SS-1000 

FAA-E-2917 

FAA-E-2911 

FAA-G-2100 
NAS-IR-TBD 
NAS-IR-TBD 
NAS-IR-TBD 
NAS-lR-5 1070000 


FAA  Standards 


NAS  System  Specification  Volume  1,  Functional  and  Performance 
Requirements  for  the  National  Airspace  System  General. 

Specification  for  the  Weather  Systems  Processor. 

Federal  Aviation  Administration  Functional  Specification  for 
National  Airspace  Systems  (NAS)  Infrastructure  Management 
System  (NIMS)  Managed  Subsystems. 

FAA  Electronic  Equipment  Specification. 

WSP  to  ASR-9  Interface  Requirements. 

WSP  to  External  Users  Interface  Requirements. 

WSP  to  Wind  Speed  and  Direction  Sensor  Interface  Requirements. 

NAS  Infrastructure  Management  System  (NIMS) 
Manager/Managed  Subsystem  using  the  Simple  Network 
Management  Protocol,  version  1  (SNMPvl)  Draft,  dated 
November  15,  1996. 


FAA-STD-024B  Preparation  of  Test  and  Evaluation  Plans  and  Test  Procedures, 

August  22,  1 994. 


Other  FAA  Publications 


FAA  AMS  FAA  Acquisition  Management  System  (AMS),  dated  April  1,  1996. 

ARIG:  96-1  Acquisition  Reform  Interim  Guidance  (ARIG):96-1,  dated  July  12, 

1996. 
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NCP  18718 


FAA  Order 
1600.54 

FAA  Order 
1800.58 

FAA  Order 
1810.4B 

FAA  Order 
1810.6. 

FAA  Order 
3900-1 9A 


ASR-9  Weather  Systems  Processor  (WSP)  Demonstration  at 
Albuquerque  International  Airport  (1996  DEMVAL). 

FAA  Automated  Information  Systems  Security  Handbook. 

National  Airspace  Integrated  Logistics  Support  (NAILS)  Policy. 

FAA  NAS  Test  and  Evaluation  Policy,  October  22,  1992. 

Policy  for  Use  of  Non-developmental  Items  (NDI)  in  FAA 
Acquisitions,  November  13,  1992. 

Occupational  Safety  and  Health. 


FAA  Order 
6310.19 

WSP  ASP 


WSPRD 
WSP  MNS 
WSP  SOW 

MILITARY  STANDARDS 


Maintenance  of  the  Airport  Surveillance  Radar-9  (ASR-9). 

Acquisition  Strategy  Paper  for  the  Weather  System  Processor, 
January  30,  1997. 

Requirements  Document  for  the  Weather  Systems  Processor. 
Mission  Need  Statement  for  the  Weather  Systems  Processor. 
Statement  of  Work  for  the  Weather  Systems  Processor. 


MIL-STD-973  Configuration  Management. 

MlL-STD-498  Software  Development  and  Documentation,  December  1994. 

MISCELLANEOUS  REPORTS 


DOT/FAA/CT-TN92/48 


DOT/FAA/CT-TN94/4 


Final  Report  for  the  ATC  Evaluation  of  the  Prototype  ASR-WSP  at 
Orlando  International  Airport,  FAA  Technical  Note,  March  1993. 

Final  Report  for  the  Operational  OT&E  of  the  Prototype  ASR- 
WSP  at  Albuquerque  International  Airport,  FAA  Technical  Note, 
March  1994. 
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Phase  I/II  DEMVAL 
Plan  (dated  1 0/96) 

Phase  I  DEMVAL 
Monitoring  Report 
(dated  2/12/96) 

MIT/LL  Wx  Project 
Memorandum  No. 
43PM-WX-0045 

ATC-247 


ATC-249 


ATC-255 


WSP  Phase  I/Il  Demonstration/Validation  (DEMV/\L)  Plan, 
ACT-320,  Weather  Systems  Branch. 

Phase  I  Demonstration/Validation  (DEMVAL)  Monitoring  Report 
of  Albuquerque,  NM  Terminal  Radar  Development  Facility 
(TRDF)  Activities  Conducted  January  16-22,  1996. 

Evaluation  of  the  Effects  of  the  Weather  Systems  Processor  (WSP) 
Hardware  on  ASR-9  Performance,  dated  August  30,  1996. 


MIT/LL:  ASR-9  Weather  Systems  Processor  (WSP)  Wind  Shear 
Algorithms  Performance  Assessment,  May  7,  1 996. 

MIT/LL:  Assessment  of  the  Delay  Aversion  Benefits  of  the  Airport 
Surveillance  Radar  (ASR)  Weather  Systems  Processor  (WSP),  July 
2,  1996. 

MIT/LL:  ASR-9  Weather  Systems  Processor  Signal  Processing 
Algorithms,  July  24,  1996. 
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3  WSP  SYSTEM  DESCRIPTION. 


3  1  WSP  SYSTEM  IMPLEMENTATION. 

The  prototype  WSP  was  developed  using  COTS  hardware  and  NDI  components  from  the  ASR-9 
and  the  TDWR.  The  prototype  WSP  hardware  and  software  will  be  used  by  the  contractor  for 
their  engineering  design  model. 

Procurement  of  the  WSP  will  be  in  compliance  with  AMS,  dated  April  1,  1996.  The  FAA- 
managed  contract  requires  the  contractor  to  provide  all  services,  materials,  and  data  necessary  to 
design,  develop,  fabricate,  test,  deliver,  install,  and  check  out  the  WSP  equipment  as  a  turnkey 
system. 

The  prototype  hardware  consists  of  NDI  components.  The  contractor  has  the  discretion  of  using 
the  same  hardware  architecture,  or  replacing  the  components  with  newer  technology.  The 
meteorological  algorithms  will  be  GFP.  MIT/LL  will  provide  the  coding  for  these  algorithms. 

3  2  WSP  FUNCTIONAL  DESCRIPTION. 

Refer  to  figure  3.2-1  WSP  Functional  Block  Diagram. 

The  WSP  functions  as  a  safety  enhancement  at  those  airports  using  ASR-9  radars  through  the 
timely  detection  and  reporting  of  hazardous  wind  shear  in  and  near  the  terminal  approach  and 
departure  zones.  The  WSP  will  detect  and  process  these  low-level  wind  shears  due  to 
microbursts  and  gust  fronts  using  ASR-9  data  and  meteorological  product  algorithms.  These 
hazardous  conditions  will  then  be  communicated  to  air  traffic  controllers  using  an  alphanumeric 
Ribbon  Display  Terminal  (RDT)  and  Geographic  Situation  Display  (GSD).  Six  level  weather 
without  anomalous  propagation  will  also  be  detected  and  tracked.  Specifically,  the  WSP  will 
provide  the  following  products/functions: 

a  Detect,  locate,  quantify,  and  display  low-altitude  terminal  area  wind  shear  and 
microburst  events, 

b.  Detect,  locate,  quantify,  predict  and  display  the  current  and  future  location  of  gust 

fronts, 

c.  Detect,  locate,  quantify,  extrapolate  and  display  the  future  position  of  storm  cells, 

d.  Generate  runway  specific  alerts  in  the  event  of  hazardous  wind  shear  and  microburst 

events, 

e.  Generate  National  Weather  Service  (NWS),  anomalous  propagation  (AP)  corrected 
6-Ievel,  precipitation  intensity  maps. 
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WSP  Six-level  weather 


FIGURE  3.2-1.  WSP  FUNCTIONAL  BLOCK  DIAGRAM 


3.2. 1  Major  Functional  Areas. 

The  WSP  is  comprised  of  four  major  functional  areas: 

a.  Radar  Data  Acquisition  (RDA); 

b.  Radar  Data  Processor  (RDP); 

c.  Display  Function  (DF);  and 

d.  WSP  Remote  Monitoring  Function  (RMF). 

32  1.1  RDA 

The  RDA  consists  of  microwave  and  digital  interfaces  to  the  ASR-9,  including  a  high-dynamic 
range  receive  chain  that  provides  inphase  and  quadrature  samples  to  the  WSP  data  processor. 

The  RDA  acquires  microwave  signals  from  the  ASR-9,  as  well  as  associated  timing,  reference, 
and  radar  state  data.  The  RDA  performs  certain  control  functions  for  Instantaneous  Automatic 
Gain  Control  (lAGC)  within  the  WSP  and  Sensitivity  Time  Control  (STC)  within  the  weather 
portion  of  the  ASR-9.  The  RDA  will  format  data  for  use  by  the  RDP. 

3. 2. 1.2  RDP 

The  RDP  is  a  COTS  data  processor  that  receives  data  from  the  RDA  and  performs  time  series 
recording,  base  data  generation,  and  data  archiving.  The  RDP  supplies  the  generated  products  to 
the  Terminal  Radar  Approach  Control  (TRACON)  and  Air  Traffic  Control  Tower  (ATCT)  for 
use  on  the  RDTs  and  GSDs.  In  addition,  the  RDP  will  feed  back  WSP-generated  six  level 
weather  less  anomalous  propagation  to  the  ASR-9  for  display  on  air  traffic  controllers’  displays 
and  Digital  Bright  Radar  Indicator  Tower  Equipment  (DBRITE). 

3  2.1.3  DF. 

The  DF  will  communicate  with  the  RDP  through  communication  lines  to  provide  display  and 
control  for  alphanumeric  and  graphical  wind  shear  information,  and  to  provide  audible  and  visual 
alarms  in  the  TRACON  and  ATCT.  Each  Display  Functional  Unit  (DFU)  will  be  composed  of 
one  GSD  and  one  to  eight  RDTs  per  GSD.  The  DFU  displays  the  weather  information  using  the 
supervisor’s  GSD  and  the  controllers’  alphanumeric  RDT;  the  GSDs  and  RDTs  are  collectively 
known  as  the  DF.  The  configuration  layout  of  the  screens  is  similar  to  that  of  the  TDWR  and 
ITWS.  The  RDT  will  be  an  alphanumeric  display  with  audible  and  visual  alarms  for  use  in  the 
ATCT  and  at  the  supervisor  or  traffic  management  unit  (TMU)  position  in  the  TRACON.  The 
RDT  will  present  hazardous  warnings  to  controllers  who  then  relay  this  information  to  affected 
pilots.  Weather  information  on  the  GSD  will  be  used  to  assist  the  ATCT  and  TRACON 
supervisors  for  runway  management.  The  DF  enables  operators  to  issue  commands,  display 
weather  products,  and  archive  data. 
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3.2.1  4  WSPRMF. 


The  WSP  RMF  will  monitor  critical  system  performance  data  and  perform  system  performance 
status  monitoring,  reporting,  maintenance  alert  and  alarm  processing,  command  and  control  of  the 
WSP  system,  and  automatic  fault  isolation  for  the  WSP.  Additionally,  the  RMF  will  obtain  and 
store  in  the  local  data  file  certification  test  data  that  include  values  of  all  internal  operating 
parameters  required  for  certification.  The  WSP  RMF  allows  entry  of  site  adaptable  data  and 
provides  maintenance  related  data  to  FAA  maintenance  specialists.  Upon  NAS  Infrastructure 
Management  System  (NIMS)  or  Maintenance  Data  Terminal  (MDT)  command,  the  RMF  will 
execute  performance  tests  to  verify  that  the  WSP  is  operating  within  operational  specifications. 

3. 2. 2  Unique  Operational  and  Performance  Characteristics. 

There  are  two  unique  characteristics  identifiable  for  the  WSP: 

a.  The  WSP  must  interface  directly  with  the  ASR-9  without  degrading  the  ASR-9  system 
performance, 

b.  The  WSP  must  provide  independent  processing  of  the  ASR-9  data  to  generate  new 
weather  radar  products  similar  in  quality  and  appearance  to  the  TDWR. 

3.3  INTERFACES. 

WSP  external  and  internal  interfaces  are  shown  in  figure  3.3-1 . 
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FIGURE  3.3-1.  WSP  INTERNAL/EXTERNAL  INTERFACE  BLOCK  DIAGRAM 


3.3.1  External  Interfaces. 


The  WSP  will  interface  with  the  following  external  systems. 

a.  ASR-9.  The  WSP  will  directly  interface  with  the  ASR-9  system  to  receive  primary 
radio  frequency  (RF),  timing,  reference,  and  control  signals.  The  WSP  reconstituted  six  levels  of 
reflectivity  minus  AP  will  be  routed  through  the  ASR-9  Surveillance  Communications  Interface 
Processor  (SCIP)  to  an  interim  NAS  configuration  of  external  interfaces  consisting  of  the 
Automated  Radar  Tracking  System  (ARTS)  Data  Entry  and  Display  System  (DEDS)  and 
DBRITE. 

b.  WIND  SPEED  AND  DIRECTION  SENSOR.  The  WSP  will  be  capable  of  accepting 
centerfield  wind  speed  and  direction  data  from  either  the  Automated  Surface  Observing  System 
(ASOS)  or  the  Low  Level  Wind  Shear  Alert  System  (LLWAS).  This  data  will  be  utilized  by  the 
WSP  in  the  GFP  processing  and  display  software.  WSP  will  accept  input  of  this  government 
furnished  data  (GFD)  at  a  government  approved  location  in  the  equipment  room. 

c.  NIMS.  The  WSP  RMF  is  capable  of  adjustment,  command,  and  control  of  the  WSP 
system.  The  WSP  RMF  provides  system  performance  and  status  information  to  the  NIMS,  the 
interface  between  the  WSP  and  the  end  user  by  providing  functions  needed  to  perform  local  and 
remote  monitoring,  automatic  fault  isolation  to  the  Line  Replaceable  Unit  (LRU)  level,  variable 
parameter  adjustment,  and  control  of  the  WSP  system.  The  WSP  RMF  will  allow  equivalent 
control  from  either  the  MDT  or  NIMS. 

d.  SPARE  DFU  PORTS.  The  WSP  will  provide  a  broadcast  protocol  supporting  up  to 
nine  external  DFUs. 

3.3,2  Internal  Interfaces. 

The  WSP  will  interface  with  the  following  internal  subsystems.  Refer  to  figure  3.3-1 . 

a.  DFU.  The  DF  will  reside  in  the  ATCT  and  the  TRACON  within  the  DFUs.  Each 
DFU  will  include  COTS  computers  capable  of  compiling  and  subsequently  executing  in  real-time 
the  Government-supplied  DF  software.  A  DFU  is  composed  of  one  or  more  GSDs  and  one  to 
eight  RDTs  per  DFU. 

The  DFU  has  the  following  capabilities; 

1 .  The  WSP  will  continuously  store,  without  user  intervention,  the  last  1 5  days  of 
all  generated  weather  products  and  the  weather  products  which  were  displayed  on  each  of  the 
DFUs.  Upon  MDT  command,  the  archived  data  will  be  transferred  to  a  removable  physical 
storage  medium.  Archiving  functions  will  be  provided  as  part  of  the  WSP  GFP  software  package. 
The  contractor  will  provide  a  suitable  interface  and  physical  storage  media  to  meet  the 
requirements  of  the  GFP  software.  Archive  data  will  be  tagged  with  synchronized  time  values. 
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2.  The  GSD  computer  will  support  a  UNIX/X-Windows  graphical  applications 
package.  It  will  have  a  100-megahertz  (MHz)  or  greater  Central  Processing  Unit  (CPU),  32 
megabytes  (MB)  or  greater  Random  Access  Memory  (RAM)  and  a  1  gigabyte  or  greater  hard 
disk.  Communication  between  the  RDP  and  DFU  will  be  accomplished  via  Transport  Control 
Protocol/Internet  Protocol  (TCP/IP)  protocols  at  bandwidths  of  128  kilobaud  (kb)  or  greater.  The 
DFU’s  ethernet  port  will  support  transfer  rates  of  10  MHz  or  greater  to  accommodate  higher 
bandwidth  communication  requirements  within  the  WSP’s  ATCT  Local  Area  Network  (LAN). 

3.  The  DFU  will  produce  audible  and  visual  alarms  when  a  weather  product  alarm 

is  generated. 

b.  MDT.  The  WSP  RMF  allows  control,  monitoring,  and  troubleshooting  capability  of 
the  WSP  from  either  the  MDT  or  the  NIMS.  The  WSP  MDT  will  provide  on-site  maintenance  of 
the  WSP. 

c.  TIME  SERIES  RECORDER  PORT.  The  WSP  will  provide  a  port  for  real-time 
recording  to,  and  playback  from,  a  time  series  recorder.  An  interface  to  a  high-speed,  high 
density  8  millimeter  (mm)  tape  or  disk  to  support  this  function  will  be  provided  along  with  the 
appropriate  software  to  facilitate  recording  and  playback. 

d  LOCAL  BASE  DATA  DISPLAY.  The  WSP  will  provide  an  interface  and  software  to 
drive  a  local  Base  Data  Display  (BDD)  capable  of  displaying  WSP  base  data,  intermediate 
products  and  end-user  products  in  both  real-time  and  playback  modes. 

e.  BASE  DATA  RECORDER  PORT.  The  WSP  RMF  will  control  recording  and 
playback  of  base  data  through  the  base  data  recording  port. 

f  ARCHIVE  RECORDER.  The  WSP  will  interface  with  the  Archive  Recorders  as 
required  by  the  GFP  RDP  software. 

g  MODEMS.  The  contractor  will  furnish  RDP  to  DF  modems,  as  required.  These 
modems  will  conform  to  FAA-E-2786  and  ElA-530  (any  standards  applicable  to  communications 
circuits  effective  on  the  date  of  the  contract  will  also  apply  and  take  precedence).  The 
Government  will  furnish  all  dedicated  communication  lines  and  all  dial-up  communication  lines. 

3  4  WSP  CRITICAL  PERFORMANCE  PARAMETERS  (CPP). 

The  WSP  Operational  Test  and  Evaluation  (OT&E)  will  demonstrate  operational  suitability  and 
effectiveness  of  the  WSP  according  to  the  critical  performance  thresholds  as  defined  in  the  WSP 
RD.  Table  3.4-1  provides  a  list  of  CPPs  for  the  WSP  as  referenced  in  the  RD. 
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TABLE  3.4-1.  WSP  CRITICAL  PERFORMANCE  PARAMETERS  (CPP). 


1  CRITICAL  PARAMETER 

THRESHOLD 

REMARKS 

System  Performance 

Wind  Shear 

Intensity 

-  Wind  shear  with  loss 

Wind  loss  >  20  knots  but 
<  30  knots 

WSP  shall  issue  an 
alert  for  each 
detected  occurrence 

-  Microburst 

Wind  loss  >  30  knots 

-  Wind  shear  with  gain 

Wind  gains  >  15  knots 

Coverage 

-  Azimuth 

-  Range 

Full  360  degrees 

6  nmi  from  airport  reference 
point  (ARP) 

Applies  to  Wind 

Shear  and 

Microburst 

-  Altitude 

Surface  to  1500  ft.  above 
ground  level  (AGL.) 

Probability  of  Detection  (PD) 

-  PD  for  wind  shear  with  losses 
>  20  knots 

PD^  0.7 

-  PD  for  microburst  with  wind  losses 

>  30  knots 

>  40  knots 

PD  ^  0.8 

PD  2: 0.9 

Probability  of  False  Alarm  (PFA) 

-  PFA  for  wind  shear  with 
wind  loss  >  20  knots 

PFA<  0.2 

-  PFA  that  a  microburst  is  false 
wind  loss  >  30  knots 
wind  loss  >  40  knots 

PFA  <0.15 

PFA  <0.1 
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CRITICAL  PARAMETER 

THRESHOLD 

Accuracy  (GSD  Display)  -  Wind  shear 
hazards  (to  be  met  everywhere) 

-  Position  of  Wind  shear 

Nearest  range  bin  of  1  st 
encounter 

-  Intensity  (5  knot  increments) 

>  70%  of  events  to  an  accuracy 
of  1 0  knots  or  20%  of  wind 
speed  change,  whichever  is 
greater 

Product  Update  Rate 

<30  seconds 

Gust  Front  and  Wind  Shift  Prediction 

Coverage 
-  Azimuth 

Full  360  degrees 

-  Range 

1 5  nmi  from  the  ARP 

-  Altitude 

Surface  to  1500  feet  AGL 

Probability  of  Detection 

(to  be  met  everywhere) 

>  20  knots  but  <  30  knots 

>  30  knots 

PD  >  0.6 

PD  >  0.75 

Probability  of  False  Alarms 

(to  be  met  every^vhere) 

>  20  knots  but  <  30  knots 
>30  knots 

PFA<0.15 

PFA<0.1 

Product  Update  Rate 

<  1  minute 

1  Storm  Motion  Dcniction 

Coverage 
-  Azimuth 

Full  360  degrees 

-  Range 

0  to  60  nmi. 

-  Altitude 

To  the  altitude  limits  of  the 
(host)  ASR 

REMARKS 


Wind  Shear  and 
Microburst  Alerts 
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CRITICAL  PARAMETER 

THRESHOLD 

Accuracy 

Speed  Direction  Estimates 

-  Speed  Estimate  RMF  Error 

<  5  knots 

-  Direction  Estimate  RMF  Error 

<30  degrees  provided 
that  speed  >  5  knots 

Storm  Extrapolated  Positions 
-  1 0  Minute  Forecasts 

Leading  Edge  Position 

Accurate  50%  of  time 

-  20  Minute  Forecasts 

Leading  Edge  Position 

Accurate  30%  of  time 

Product  Update  Rate 

<  1  minute 

Coverage 
-  Azimuth 

Full  360  degrees 

-  Range 

Oto  60  nmi. 

-  Altitude 

To  the  altitude  limits  of  the 
host  ASR 

Inadvertent  Edit 

The  WSP  shall  not  edit  more 
than  5%  of  actual  weather 
reflectivity  regions  with 
reflectivity  of  level  3  or 
greater. 

Edit  Performance 

The  WSP  shall  edit  90%  or 
more  of  AP  when  the 
corresponding  level  of  AP  is  3 
or  greater. 

Product  Update  Rate 

<  30  seconds 

REMARKS 
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3.5  CRITICAL  OPERATIONAL  ISSUES  (COI). 


1.  Will  the  integration  of  WSP  with  the  host  ASR  prevent  recertification  of  the  ASR? 

The  ASR-9  is  essentially  a  terminal  radar;  its  primary  function  is  tarpt  detection.  It  is  most 
important  that  the  ASR-9  system  is  not  degraded  when  the  WSP  is  interfaced  to  it.  The  ASR-9  is 
the  first  radar  system  to  receive  the  WSP . 

In  an  effort  to  address  this  COI,  MIT/LL  is  conducting  DEMVAL  testing  at  the  Terminal  Radar 
Development  Facility  (TRDF)  in  Albuquerque,  NM,  and  ACT-320  is  conducting  some  integration 
testing  at  the  Technical  Center.  Of  this  testing  completed  to  date,  there  appears  to  be  no 
significant  degradation  to  the  ASR-9.  However,  these  tests  are  limited  and  do  not  include  the 
majority  of  the  WSP  interfaces  (e  g.,  no  WSP  RMF,  no  WSP  processor,  no  WSP  switches,  etc.). 

In  addition,  production  hardware  was  not  used. 

This  COI  will  be  fiilly  resolved  during  System  Test  conducted  on  the  production  WSP  at  the 
Technical  Center  and  key  site(s).  At  the  Technical  Center,  baseline  readings  will  be  taken  and  will 
include  all  ASR-9  critical  parameters  (from  both  channels  before  and  after  WSP  installation)  to 
measure  the  amount  of  degradation  to  coverage,  to  discern  induced  faults  and  to  verify 
calibrations  and  alignments.  Live  weather  data  will  be  collected  both  before  and  after  the  WSP  is 
installed.  A  flight  check  will  also  be  conducted  after  the  WSP  is  installed.  The  above  procedure 
will  also  be  followed  at  the  first  key  site  (except  for  the  flight  check  which  will  be  conducted  at 
the  discretion  of  the  Test  Planning  Working  Group  (TPWG)).  Any  degradation  issues  found  as  a 
result  of  testing  will  be  satisfactorily  addressed  by  the  TPWG. 

2.  Does  the  WSP  system  provide  weather  products  that  are  sufficient  for  Air  Traffic  (AT) 
use  ? 

WSP  weather  products  are  listed  in  table  3.4-1  and  in  table  1  of  the  WSP  RD.  This  listing 
includes  minimum  operational  thresholds  that  must  be  met  for  weather  products  to  be  sufficient 
for  AT  use.  The  WSP  weather  products  will  be  verified  during  OT&E  testing  at  key  sites.  A 
combination  of  live  weather  events  and  government  furnished  test  tapes  will  be  used  to  verify  that 
the  WSP  weather  products  are  sufficient  for  AT  use. 

3.  Will  WSP  products  enhance  the  effectiveness  of  traffic  planning/management  (delays, 
airport  acceptance  rate,  traffic  flow,  etc.)  during  adverse  weather  conditions  in  the  terminal 
area  ?  Are  terminal  airspace  and  runway  used  more  effectively  ? 

This  COI  has  been  satisfactorily  addressed  by  MIT/LL  Project  Report  ATC-249,  Assessment  of 
the  Delay  Aversion  Benefits  of  the  Airport  Surveillance  Radar  (ASR)  Weather  Systems  Processor 
(WSP),”  dated  July  1996. 

This  report  assesses  the  magnitude  of  the  delay  aversion  benefits  that  will  be  realized  through 
national  deployment  of  the  WSP.  These  benefits  are  quantified  both  in  terms  of  aircraft  delay- 
hour  reductions  and  corresponding  dollar  benefits.  The  analysis  indicates  that  these  benefits  will 
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total  approximately  $18M  per  year  given  year  2000  expected  traffic  counts  at  the  planned  WSP 
airports.  This  exceeds,  in  equivalent  dollar  value,  the  safety  benefits  realized  through  WSP 
deployment  by  a  factor  of  approximately  five. 

3.6  MINIMUM  OPERATIONAL  PERFORMANCE  (MOP). 

The  WSP  in  the  terminal  area  must  provide  data  to  enable  determination  of  the  position  and 
intensity  of  hazardous  low  altitude  wind  shear  in  the  terminal  area  and  especially  along  an 
aircraft's  projected  approach  or  departure  path.  Gust  front  coverage  is  required  to  1 5  nautical 
miles  (nmi)  from  the  airport.  A  high  probability  of  detection  with  a  low  false  alarm  rate  is 
required  (see  section  3.4,  table  3.4-1).  Precipitation  as  measured  by  reflectivity  is  required  to 
discern  thunderstorm  cells  to  the  instrumental  range  of  the  host  radar.  The  WSP  must  provide  an 
improved  ASR-9  six-level  weather  map  without  AP  error. 
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4  TEST  AND  EVA!  .1 JATION  MANAGEMENT. 


4. 1  MANAGEMENT  (ORGANIZATIONAL  AND  FUNCTIONAL  RESPONSIBILITIES). 

The  management  process  and  the  participating  organizational  roles  and  responsibilities  relative  to 
the  support  of  WSP  T«feE  activities  are  presented  in  the  following  paragraphs. 

4  1.1  Integrated  Product  Team  for  Surveillance  and  Weather  (AND-400}. 

a.  Develops  and  reviews  the  WSP  IPP, 

b.  Provides  Product  Lead  for  WSP, 

c.  Endorses  policy  waiver  requests  initiated  by  the  Product  Lead, 

d.  Reviews  and  provides  approval  on  all  NCPs. 

4. 1 .2  Wind  Shear  PT  Lead  (AND-420). 

The  WSP  program  is  under  the  authority  of  the  FAA  Wind  Shear  Products  Team,  AND-420.  The 
Product  Lead  and  designated  staff  are  responsible  for  the  procurement  and  implementation  of  the 
WSP,  from  mission  analysis  through  contract  award,  development,  installation,  checkout, 
integration  into  the  NAS,  and  system  commissioning.  The  Product  Lead  directs  and  manages  all 
FAA  activities  for  the  development  and  implementation  of  the  WSP.  With  regard  to  the  WSP 
T&E  program,  the  Product  Lead: 

a  Facilitates  Product  Team  review  and  approval  of  WSP  TEMP, 

b.  Arranges  with  the  Team  Lead  for  Test  for  T&E  support,  planning,  conduct  and 
implementation  through  an  annual  program  directive  (PD), 

c.  Presents  test  deployment  issues  to  the  In-Service  Review  Committee, 

d.  Prepares  test  NCPs  for  designated  test  locations, 

e.  Approves  Development  Test  and  Evaluation  (DT&E)  plans,  procedures,  and  reports, 
f  Monitors  DT&E  contractor  conducted  testing, 

g.  Approves  OT&E  test  requirements,  plans,  procedures,  and  reports, 

h.  Monitors  OT&E  testing,  . 

i.  Reviews  Field  Familiarization  requirements  with  the  Airway  Facilities  (AF)  Division 

organization, 

j.  Reviews  Production  and  Acceptance  Test  and  Evaluation  (PAT&E)  test  plans, 
procedures,  and  reports, 

k.  Monitors  Field  Familiarization  testing, 

l.  Maintains  system  configuration  management  (CM), 

m.  Member  of  TPWG. 

4  1  3  Communication.  Navigation  &  Surveillance  Engineering  and  Test  Division  (ACT-300). 


a.  Provides  Team  Lead  for  Test, 

b.  Endorses  project  TEMP, 
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c.  Provides  for  Technical  Center  facility  readiness. 

4. 1 .4  Technical  Center  Weather  Branch  ('ACT-320). 

The  Team  Lead  for  Test  is  provided  by  the  Weather  Branch  (ACT-320)  organization  located  at 
the  Technical  Center.  The  Team  Lead  for  Test  acts  as  the  agent  of  the  Product  Lead  to  manage 
the  WSP  T&E  program.  The  Team  Lead  for  Test  is  responsible  for  the  conduct  of  overall  system 
test  activities,  specifically  OT&E  testing.  Responsibilities  of  the  Team  Lead  for  Test  include; 

a.  With  the  Product  Lead,  develops  WSP  TEMP  for  approval  by  the  Wind  Shear  and 
Weather  Radar  Product  Team, 

b.  Prepares  OT&E  test  requirements  for  inclusion  in  the  TEMP, 

c.  Reviews  WSP  acquisition  documents  and  provides  input  for  T&E, 

d.  Prepares  OT&E  test  plans  and  procedures  in  accordance  with  ARIG  96-1 , 
FAA-STD-024B,  FAA  Order  1810.4B  or  any  other  applicable  document, 

e.  Establishes  and  chairs  a  TPWG  with  cognizant  FAA  organizations  to  fund  and/or 
arrange  for  organizations'  participation  and/or  support  in  test  and  evaluation  activities, 

f  Prepares  OT&E  test  reports  and  provides  recommendations  based  on  test  results  to 
AND-420  in  support  of  In-Service  Review  (ISR), 

g.  Reviews  DT&E  test  plans,  procedures,  and  reports, 

h.  Monitors  DT&E  tests  performed  by  the  contractor  at  the  contractor's  facility,  as  well 
as  at  any  government  designated  test  sites, 

i.  Monitors  PAT&E  and  site  acceptance  of  the  limited  production  first  article  systems, 

j.  Conducts  Test  Schedule  Status  Review  (TSSR)  meetings  as  necessary  in  order  to 
plan,  direct,  status,  and  report  on  T&E  activities, 

k.  Reviews  and  provides  concurrence  on  all  WSP  NCPs, 

l.  Directs  and  conducts  OT&E  tests, 

m.  Reviews  Field  Familiarization  requirements,  plans,  procedures,  and  reports, 

n.  Coordinates  required  system  downtime  with  Airway  Facility  (AF)  personnel, 

o.  Assures  Technical  Center  test  site  preparation. 

4.1.5  Air  Traffic  Plans  and  Requirements  Service  (ATR). 

a.  Provides  requirements  for  and  reviews  the  FAA  TEMP, 

b.  Supports  and  reviews  OT&E  test  plan  development,  and  when  necessary  coordinates 
approval  with  union, 

c.  Provides  operational  expertise  and  planning  for  conducting  and  analyzing  tests, 

d.  Provides  personnel  to  support  monitoring  and  conduct  of  OT&E, 

e.  Reviews  OT&E  test  reports, 
f  Member  of  TPWG, 

g.  Reviews  and  provides  concurrence  on  all  WSP  NCPs, 

"h.  Reviews  field  familiarization  requirements,  plans,  procedures,  and  reports, 
i.  Coordinates  required  system  downtime  with  field  AT  personnel. 


21 


4. 1 .6  Communications/Infrastructure  (ACT-330). 


The  Communications/Infrastructure  Branch  will  provide  the  following  test  support  functions  as 
required  in  support  of  the  ACT-320  Team  Lead  for  Test. 

a.  Reviews  OT&E  test  requirements,  plans,  and  reports, 

b.  Supports  the  development  of  the  TEMP, 

c.  Reviews  WSP  acquisition  documents  and  provides  input  for  T«S:E, 

d.  Witnesses  and/or  participates  in  NIMS  Confidence  testing,  as  required, 

e.  Provides  personnel  in  support  of  the  performance  and/or  monitoring  of  the  NIMS 
DT&E  effort, 

f.  Review  all  forms  of  test  documentation  (DT&E,  OT&E,  and/or  PAT&E)  as  requested 
in  support  of  the  acquisition  process. 

4. 1.7  Product  Team  Lead  for  NIMS  (AND-130). 

a.  Conduct  NIMS  Pre-Confidence/Confidence  testing, 

b.  Review  all  forms  of  test  documentation  (DT&E,  OT&E,  and/or  PAT&E)  as  requested 
in  support  of  the  acquisition  process, 

c.  Member  of  TPWG. 

4. 1 .8  Operational  Support  Service  (AOS). 

The  Weather  Systems  Engineering  Branch  (AOS-250),  of  the  Operational  Support  Service,  will 
support  T&E  under  the  direction  of  the  Team  Lead  for  Test .  AOS-270,  the  Radar  Branch 
located  at  the  Technical  Center,  will  provide  assistance  and  technical  support  to  aid  in  the 
resolution  of  technical  issues  related  to  ASR/WSP  integration.  Additional  AOS  organizational 
responsibilities  include: 

a.  Supports  the  development  of  the  TEMP, 

b.  Reviews  OT&E  test  requirements,  plans,  and  reports, 

c.  Provides  personnel  in  support  of  the  performance  and/or  monitoring  of  T&E, 

d.  Reviews  technical  instruction  books  for  completeness  and  technical  accuracy, 

e.  Develop  OT&E  Test  Plans  and  Procedures  for  (live/tape)  Weather  Testing, 
f  Member  of  TPWG, 

g.  Provide  data  on  results  of  Weather  Testing  for  inclusion  in  the  WSP  OT&E  Final 
Report, 

h.  Provides  support  during  Field  Familiarization  Testing. 

4. 1 .9  Regional  AT  Division. 

a.  Supports  the  Product  Lead  via  ATR  in  the  development  of  test  requirements  for 
inclusion  in  the  FAA  TEMP, 

b.  Supports  the  Product  Lead  in  the  implementation  of  the  FAA  TEMP  at  test  and 
operational  facilities  as  required  by  ATR, 
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c.  Supports  the  AF  Division  in  the  development  of  Field  Familiarization  requirements, 
plans,  procedures,  and  reports  with  the  inclusion  of  Regional  AT  Division  objectives 
and  interests, 

d.  Participates  in  the  conduct  of  NAS  Integration  and  Operational  Test  as  coordinated 
with  the  ATR  organization, 

e.  Supports  Field  Familiarization  that  is  in  satisfaction  of  Regional  AT  Division  test 
requirements  or  objectives,  as  coordinated  with  AF  Division, 

f  Conducts  Field  Familiarization  in  coordination  with  AF  Division, 

g.  Monitors  Field  Familiarization, 

h.  With  the  AF  Division,  co-approves  Field  Familiarization  requirements  with  the 
Product  Lead, 

i.  Reviews  Program  Directives  established  in  support  of  the  Product  Lead  and  Team 
Lead  for  Test. 

4.1.10  Regional  Airway  Facilities  (AF)  Division. 

a.  Supports  the  Product  Lead  in  the  development  of  test  requirements  for  inclusion  in  the 
FAA  TEMP, 

b.  Reviews  Program  Directives  established  in  support  of  the  Product  Lead  and  T earn 
Lead  for  Test, 

c.  Supports  the  Product  Lead  in  the  implementation  of  the  FAA  TEMP  at  test  and 
operational  facilities, 

d.  With  the  AT  Division,  co-approves  Field  Familiarization  requirements  with  the 
Product  Lead, 

e.  Approves  Field  Familiarization  plans,  procedures,  and  reports, 

f  Participates  in  the  conduct  of  NAS  Integration  and  Operational  Test  as  coordinated 
with  ACT  and  AOS, 

g.  Directs  Field  Familiarization  that  is  in  satisfaction  of  AF  Division  test  requirements  or 
objectives  and  as  coordinated  with  AT  Division, 

h.  Conducts  Field  Familiarization  in  coordination  with  AT  Division. 

4.1.11  AF  Sectors. 

a.  Participates  in  FAA  TEMP  activities  as  required  by  AF  Division, 

b.  Develops  Field  Familiarization  requirements,  plans  and  procedures  in  coordination 
with  the  facility  AT  organization, 

c.  Conducts  Field  Familiarization,  including  Joint  Acceptance  Inspection  (JAI)  and 
reports  results  in  coordination  with  facility  AT  organization. 

Participates  in  the  conduct  of  OT&E  Testing  as  coordinated  with  ACT  and  AOS. 

4. 11 2  AT  Facilities. 

a.  Participates  in  FAA  TEMP  activities  as  required  by  ATR  through  Regional  AT 
Division, 
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b.  Supports  development  of  Field  Familiarization  requirements,  plans,  procedures,  and 
reports,  in  coordination  with  AP  organizations, 

c.  Conducts  and  monitors  Field  Familiarization  and  reports  results  in  coordination  with 
AF  organizations  and  Regional  AT  Division. 

4. 1 . 1 3  Logistics  (AFR-300). 

a.  Provides  Associate  Program  Manager  for  Logistics  (APML), 

b.  Responsible  for  ensuring  that  the  eight  elements  of  NAILS  have  been  addressed  and 
established,  as  applicable,  prior  to  initiation  of  OT&E  in  accordance  with  FAA  Order 
1800.58, 

c.  Supports  the  Product  Lead  in  the  development  of  test  requirements  for  inclusion  in  the 
FAA  TEMP, 

d.  Participates  in  FAA  TEMP  activities  as  required. 

e.  Reviews  T&E  plans  and  reports. 

f  Reviews  and  provides  concurrence  on  NCPs. 

g.  Member  of  TPWG. 

4.1  14  TPWG. 

The  TPWG  manages  test  activities  under  the  direction  of  the  Team  Lead  for  Test.  This  group 
consists  of,  but  is  not  limited  to,  members  appointed  from  responsible  test  organizations  as  shown 
in  table  4.1.14-1.  Temporary  members  may  be  appointed  as  required  for  specific  tasks.  The 
TPWG  will: 

a.  Develop  and  implement  the  T&E  management  process  for  the  WSP, 

b.  Meet  as  deemed  necessary  by  the  Team  Lead  for  Test  to  discuss  test  related  issues 
concerning  the  TEMP,  the  coordination  of  T&E  funding,  T&E  schedules,  and  other 
related  issues, 

c.  Provide  input  for  test  requirements  and  represent  respective  organizations  regarding 
acceptance  of  test  responsibilities  and  input  for  test  requirements. 
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TABLE  4.1.14-1.  RESPONSIBLE  TEST  ORGANIZATIONS. 


ORGANIZATION 

NAME 

ROLES/RESPONSIBILITIES 

TPWG 

ACT-32() 

Weather  Branch.  William 

J.  Hughes  Technical  Center 

Team  Lead  for  Test .  Overall 
responsibility  for  System  Test. 

Conduct  OT&E.  monitor  DT&E  and 
PAT&E 

X 

AND-130 

Product  Team  Lead  for 

NIMS 

AND-130  will  conduct 
Pre-Confidence/Confidcncc  testing 

X 

ACT-33() 

Communications/ 
Infrastructure  Branch. 
William  J.  Hughes 

Technical  Center 

Conduct  NIMS  interface  testing 
during  OT&E  Integration. 

X 

AND-420 

Weather  Products  Team 
Program  Oflice 

Product  Lead,  Ox  crall  Program 
Management  Responsibility 

X 

AOS-250 

Weather  Systems 

Engineering  Branch.  OK 

City.  OK. 

Operational  Test  Support,  Algorithm 
Implementation  Verification. 

Implement  mods  to  incorporate  the 

WSP  with  the  ASOS/LLWAS.  Assists 
in  Field  Familiarization 

X 

AOS-270 

Radar  Branch,  William  J. 
Hughes  Technical  Center 

Support  for  resolution  of  technical 
issues  related  to  WSP/ASR-9 

Integration.  Implement  mods  to  the 
ASR-9  to  incorporate  the  WSP 

X 

ATR-200  and 

ATO-100 

Weather  Division 

AT  Controllers,  Operational 
Requirements 

X 

AFR-304 

Communications/ 
Navigation/Surveillance 
Systems  Division 

APML,  Logistics  Support 

X 

MIT/LL 

Weather  Sensing  Group 

Provide  Technical  Expertise 

X 

Key  Site  Regional 
Support 

Test  Site  Coordination/Support 

X 
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4.]  .  15  MIT/LL. 


a.  Conduct  prototype  testing  during  DEMVAL, 

b.  Provide  status  reports,  lessons  learned  information  and  meteorological  data  analysis  on 
the  prototype  test  activities, 

c.  Provide  technical  support/meteorological  algorithms, 

d.  Support  overall  test  effort  on  the  technical  and  scientific  environment  of  the  WSP. 
4.116  Prime  Contractor. 

Program  Management  Reviews  (PfvlR)  will  be  conducted  in  accordance  with  the  WSP  Statement 
of  Work  (SOW)  in  order  to  monitor  the  contractor's  performance.  The  PMR  will  cover  the 
status  of  hardware  and  software  development,  system  integration  and  test,  schedule,  cost,  staffing, 
and  significant  technical  issues  and  risks  that  have  surfaced  in  the  reporting  period. 

The  contractor  will  conduct  the  Critical  Design  Reviews,  DT&E,  Test  Readiness  Review  (TRR), 
Contract  Acceptance  Inspection  (CAI),  and  first  Operational  Readiness  Demonstration  (ORD)  in 
accordance  with  the  SOW. 

Design  reviews  will  be  held  in  accordance  with  the  SOW,  in  order  for  the  product  team  to  have 
detailed  insight  into  the  technical  effort.  Contract  Data  Requirements  List  (CDRL)  items  will  be 
developed  in  accordance  with  accepted  FAA  standards  and  these  standards  will  be  the  criteria  for 
evaluating  the  deliverables.  Software  documentation  will  be  developed  using  MIL-STD-498  as 
guidance. 

The  WSP  contractor  will  be  responsible  for  the  planning,  conduct,  and  analysis  of  all  contractually 
required  testing  during  the  verification  phases.  The  FAA  will  approve  and  monitor  the 
contractor's  test  program  to  verify  that  the  system  meets  specification  requirements. 

4  2  INTEGRATED  SCHEDULE. 

The  chart  presented  in  appendix  B  depicts  the  WSP  TEMP  Integrated  Schedule.  This  schedule 
details  the  key  elements  of  the  test  program  as  well  as  relative  durations  for  acquisition  events. 

The  limited  production  test  phase  will  commence  upon  contract  award.  As  of  this  writing  DT&E 
is  scheduled  to  begin  after  contract  award.  While  the  contractor  is  conducting  DT&E  on  the 
first  article  systems,  government  test  personnel  will  be  involved  as  DT&E  test  witnesses  and  in 
the  review  and  approval  of  contractor  test  documentation.  Installation  of  the  first  limited 
production  system  at  the  Technical  Center  is  scheduled  for  8  months  after  contract  award.  OT&E 
testing  of  the  first  system  is  scheduled  to  begin  following  site  acceptance  and  installation  at  the 
first  key  site. 
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4.3  TEST  AND  EVALUATION  FUNDING. 


The  FAA  funding  profile  chart  in  table  4.3-1  contains  an  estimate  by  fiscal  year,  up  to  and 
including  fiscal  year  2002,  the  funding  required  for  the  overall  WSP  test  program. 


TABLE  4.3-1 .  WSP  FAA  T&E  FUNDING  ESTIMATION 


WSP  T&E  FUNDING 

FY 

96 

97 

98 

99 

00 

01 

02 

TOTAL 

Testing  Phase  1 

Development  T&E 

250K 

700K 

-0- 

-0- 

-0- 

-0- 

-0- 

950K 

OT&E 

-0- 

-0- 

*85()K 

700K 

400K 

lOOK 

4)- 

♦*2050K 

PAT&E 

-()- 

-0- 

-0- 

-0- 

600K 

700K 

700K 

2000K 

Total  T&E  Program  $/FY 

2f50K 

7()0K 

850K 

70()K 

lOOOK 

800K 

700K 

.SOOOK 

*  Includes  150K  for  site  preparation  at  William  J.  Hughes  Tec 

hnical  Center  in  1998 

**  Includes  funding  for  Material  Resources  (test  equipment,  computers,  communications  lines,  etc.) 
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4.4  TEST  PLANS  AND  PROCEDURES. 


Table  4.4-1  lists  the  WSP  System  Test  Plans  and  Procedures,  expected  completion  dates, 
responsible  and  approving  organizations. 


TABLE  4.4-1  WSP  SYSTEM  TEST  PLANS  AND  PROCEDURES 


SYSTEM  TEST  PLANS  AND  PROCEDURES 

Document  Title 

Expected 

Completion 

Date 

Responsible 

Organization 

Approving 

Organization 

FAA  Test  and  Evaluation  Master  Plan 
(TEMP) 

June  1997 

ACT-320 

PT 

FAA  OT&E  Test  Plan 

•  O  I'&F.  Integration,  OT&E  Operational  and 

OT&E  Shakedown  (ACT-320) 

•  WSP/NIMS  Integration  Testing  (ACT-330) 

•  Weather  Testing  (A()S-250) 

Sept.  1998 

ACT-320 

PT 

FAA  OT&E  Test  Procedures 

•  OT&E  Integration,  OT&E  Operational  and 

OT&E  Shakedown  (ACT-320) 

•  WSI’/NIMS  Integration  Testing  (ACT-330) 

•  Weather  Testing  (A()S-250) 

Oct.  1998 

ACT-320 

PT 

Field  Familiarization  Test  Plan 

TBD 

AF/AT 

Organizations 

PT 

Field  Familiarization  Test  Procedures 

TBD 

AF/AT 

Organizations 

PT 

Contractors  Master  Test  Plan  (CMTP) 

(CDRLCOI  lAWSOW) 

Upon  Contract 
Award 

Development 

Contractor 

AND-420 

Software  Test  Plan  (STP)(iiKiudesDQT/FQT) 

(CDRI.DOl  lAW  SOW) 

60  days  after 
(DA)  Critical 
Design  Review 
(CDR)  &  15 
days  after 
receipt  of 
comments 
(DARC) 

Development 

Contractor 

AND-420 

DT&E  Factory  Acceptance  Test  (FAT)/ 
Site  Acceptance  Test  (SAT)  Plan 

(CURE  DOS  lAW  SOW) 

CDR&  15 
DARC 

Development 

Contractor 

. 

AND-420 
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SYSTEM  TEST  PLANS  AND  PROCEDURES 


Document  Title 

Expected 

Completion 

Date 

Responsible 

Organization 

Approving 

Organization 

DT&E  FAT/SAT  Procedures 

(CDRL  1)06  lAW  SOW) 

FAT  -60&  15 
DARC 

Development 

Contractor 

AND-420 

SAT -60  &  15 
DARC 

PAT&E  FAT/SAT  Plan 

(CORI.  DOX  lAW  SOW) 

FAT  -90&  15 
DARC 

Development 

Contractor 

AND-420 

SAT  -90&  15 
DARC 

PAT&E  FAT  Test  Procedures 

(CDRL  D09  lAW  SOW) 

PAT&E  FAT 
-90&  15 

DARC 

Development 

Contractor 

AND-420 

PAT&E  SAT  Test  Procedures 

(CDRL  D09  lAW  SOW) 

PAT&E  SAT 
-90&  15 

DARC 

Reliability  Program  Demonstration  Plan 

(CDRL  B12IAW  SOW) 

30DACA&  15 
DARC 

Development 

Contractor 

AND-420 

Maintainability  Program/Demonstration 
Plan 

(CDRL  ni4IAW  SOW) 

30DACA&  15 
DARC 

Development 

Contractor 

AND-420 

Maintainability  Demonstration 

Procedures 

(CDRL  B16IAW  SOW) 

60  DACA&  15 
DARC 

Development 

Contractor 

AND-420 

Management  and  Installation  Plan 

(CDRL  lAW  SOW) 

CDR&  15 

DARC 

Development 

Contractor 

AND-420 

4.4. 1  Government  Test  Plans  and  Procedures. 


All  system  test  plans  and  procedures  will  be  developed  in  accordance  with  FAA  Order  1810.4B 
and  FAA-STD-024B.  The  OT&E  Test  Plans  and  Test  Procedures  will  address  NAS  integration 
requirements  and  will  verify  that  the  subsystem  interfaces  correctly  to  the  existing  elements  of  the 
NAS  and  that  the  NAS  can  operate  with  the  new  subsystem.  Operational  suitability/effectiveness 
of  the  WSP  will  be  addressed  as  well  as  reliability  and  maintainability  of  the  subsystem  as  installed 
in  the  field.  Listed  below  are  the  specific  government  test  plans  to  be  developed  for  system  test . 

a.  Test  and  Evaluation  Master  Plan  (TEMP).  The  WSP  TEMP  is  developed  jointly  by 
the  Product  Lead,  AND-420  and  Team  Lead  for  Test,  ACT-320  .  The  TEMP  is  prepared  in 
accordance  with  FAA-STD-024B  and  is  consistent  with  FAA  Order  1810.4B.  The  purpose  of  the 
TEMP  is  to  provide  the  overall  test  philosophy  and  test  strategy  for  the  WSP  test  program. 


b.  OT&E  Test  Plan.  This  plan  identifies  and  describes  the  tests  required  to  ensure  that 
the  WSP  interfaces  with  the  existing  and  future  NAS  equipment.  It  outlines  testing  of  the  NAS 
end-to-end  performance  with  the  fully  integrated  WSP  in  an  operational  configuration.  This  plan 
identifies  and  describes  the  tests  required  to  ensure  that  the  WSP  is  operationally  suitable  and 
effective.  Additionally,  this  plan  discusses  outstanding  COIs  and  will  include  a  list  of  specific 
evaluation  criteria  or  measures  of  effectiveness  (MOE)/measures  of  performance 
(MOP)/measures  of  suitability  (MOS).  The  following  issues  will  also  be  addressed. 

a.  Reliability,  Maintainability,  and  Availability  (RMA), 

b.  Degraded  Operations, 

c.  NAS  loading,  capacity,  and  delay  evaluation, 

d.  Site  Adaptation  and  Optimization, 

e.  Human  Factors, 

f  Safety, 

g.  Security, 

h.  Transition  and  Switch  Over. 

This  plan  identifies  and  describes  the  tests  (formerly  known  as  OT&E  Shakedown)  conducted  by 
the  user  organizations  to  verify  that  the  WSP  is  operationally  suitable  and  effective.  It  specifically 
addresses  the  following  issues; 

a.  Supportability  and  Maintenance  Concept, 

b.  Maintainability  in  the  NAS, 

c.  Continuing  Optimization  and  Field  Support, 

d.  Technical  Manual  Suitability, 

e.  WSP  Baseline  Evaluation. 

c.  OT&E  Test  Procedures.  These  procedures  identify  and  describe  the  detailed 
procedures  to  accomplish  the  OT&E  objectives  stated  in  the  OT&E  Plan.  Step-by-step 
procedures  will  be  defined  for  each  subtest. 

4.4.2  Contractor  Test  Plans  and  Procedures. 

The  contractor  will  develop  test  schedules,  test  plans,  test  procedures,  conduct  tests,  and  generate 
test  reports  utilizing  FAA-STD-024  as  guidance  and  as  required  by  the  SOW  for  the  WSP.  The 
contractor  test  program  will  involve  developmental  and  production  testing  of  all  specification 
requirements.  The  DT&E  for  the  first  system  test  unit  is  intended  to  ensure  that  each  subsystem 
developed  meets  all  of  the  specification  requirements  and  that  these  subsystems  can  be  integrated 
successfully  into  the  production  WSP  baseline.  The  following  is  a  description  of  each  type  of  test 
plan  that  will  be  developed  by  the  contractor  and  is  subject  to  approval  by  the  government. 

a.  Contractor's  Master  Test  Plan  (CMTP).  This  plan  contains  a  description  of  all  tests 
performed  by  the  contractor  on  the  WSP  and  will  serve  as  the  overall  control  document  for 
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contractor  conducted  testing.  The  Contractor's  Master  Test  Plan  will  be  developed  using  FAA- 
STD-024B  as  a  guiding  document. 

b.  Software  Test  Plan  (STP).  The  Software  Test  Plan  describes  Design  Qualification 
Test  (DQT)  and  Formal  Qualification  Test  (FQT)  plans  for  all  of  the  Computer  Software 
Configuration  Items  (CSCIs)  including  Algorithm  Verification  and  "Worst  Case"  testing.  The 
STP  will  identify  software  test  environment  resources  required  for  testing,  and  will  provide 
schedules  for  test  activities.  In  addition,  the  STP  will  identify  the  individual  tests  that  will  be 
performed  during  qualification  testing. 

c.  Development  Test  and  Evaluation  Factory  Acceptance  Test  and  Site  Acceptance 
Test  (DT&E  FAT/SAT)  Plan.  This  plan  identifies  and  contains  a  description  of  the  tests  that  will 
be  conducted  to  ensure  that  each  delivered  item  conforms  to  applicable  specifications,  is  free  from 
manufacturing  defects,  and  is  substantially  identical  to  the  qualified  hardware.  This  plan  will  be 
presented  to  the  government  for  approval. 

The  contractor  will  develop  DT&E  FAT/SAT  Procedures  to  accomplish  the  above. 

d.  Production  Acceptance  Test  and  Evaluation  Factory  Acceptance  Test  and  Site 
Acceptance  Test  (PAT&E  FAT/SAT)  Plan.  This  plan  identifies  and  contains  a  description  of 
Factory  and  Site  Production  and  Type  Testing  and  System  Integration.  This  document  also 
provides  the  plan  for  completing  the  Installation,  Checkout  and  Acceptance  tests.  Upon 
government  approval,  the  contractor  will  accomplish  the  site  acceptance  test  program  in 
accordance  with  this  plan. 

The  contractor  will  develop  PAT&E  FAT/SAT  Procedures  to  accomplish  the  above. 

e.  Reliability  Program/Demonstration  Plan.  This  plan  documents  the  contractor’s 
overall  methodology  for  conducting  a  reliability  program  and  provides  assurance  that  the 
reliability  requirements  of  the  WSP  specification  will  be  satisfied. 

f.  Maintainability  Program/Demonstration  Test  Plan.  This  plan  contains  a 
description  of  the  corrective  and  preventive  maintenance  demonstrations.  It  includes 
compatibility  tests  to  perform  on-line  and  off-line  diagnostics  and  LRU  diagnostics,  and  is  fully 
compatible  with  the  NIMS. 

g.  Management  and  Installation  Plan  This  plan  will  describe  how  the  contractor  will 
accomplish  the  facilities  site  preparation,  installation,  integration,  test,  implementation,  and  other 
services  as  described  in  the  WSP  SOW. 
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4.5  TEST  PROGRAM  RESOURCES. 


The  WSP  Test  Program  Resources  are  shown  in  table  4.5-1 

TABLE  4.5-1.  WSP  TEST  PROGRAM  RESOURCES 


[  WSP  T&E  PERSONNEL  REQUIREMENTS 

FY 

96 

97 

98 

99 

00 

01 

02 

Total  EY/Org 

Organization 

ACT 

m 

m 

■ 

■ 

■ 

2 

2 

34 

AOS 

2 

3 

3 

■ 

■ 

■1 

24 

AT 

1 

■ 

2 

2 

1 

■ 

■ 

9 

AF 

0 

0 

■ 

■ 

3 

■ 

3 

13 

AND 

■ 

■ 

■ 

■ 

♦Prime  Contractor  Support 

♦Total  EY /FY  &  Test  Phase 

80 

♦  Program  office  to  determine  estimates 

EY  =  employee  years 

4  51  Manpower  and  Training. 

The  WSP  test  team  consists  of  personnel  from  AT,  AF,  AND-420,  ACT-320,  ACT-330, 
AOS-250,  AOS-270  and  support  contractors.  Training  for  these  personnel  is  described  in  the 
following  paragraph. 

4  5.1.1  Test  Team  Training. 

The  Contractor  will  conduct  two  OT&E  test  team  training  courses,  one  at  the  Technical  Center 
and  the  other  at  the  FAA  Academy  in  Oklahoma  City.  Each  course  will  familiarize  the  test  team 
with  the  WSP  equipment  and  displays  to  enable  them  to  perform  and  support  OT&E  activities  and 
to  maintain  the  WSP  system.  Each  course  will  be  conducted  prior  to  OT&E  commencement  and 
will  utilize  commercial  item  training  materials  to  the  maximum  extent  possible.  Students  will  be 
instructed  on  how  WSP  test  tools  can  support  testing,  i.e.,  hardware  and  software  problem 
solving,  trouble  replication,  alternative  configuration  tryouts,  product  improvements,  and  their 
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validation,  etc.  The  Contractor  will  also  provide  supplemental  training  to  address  future  system 
upgrades.  Each  class  size  shall  not  exceed  40  students. 

4.5.2  Test  Article. 

Limited  production  systems  and  production  turnkey  systems  will  be  procured  under  the  overall 
WSP  acquisition.  Upon  completion  of  contractor  conducted  factory  testing,  the  first  limited 
production  unit  will  be  shipped  to  the  Technical  Center  for  government  test  and  evaluation. 
Subsequent  first  article  limited  production  units  will  be  shipped  to  selected  sites  as  depicted  in  the 
Master  Test  Schedule  (appendix  B).  These  limited  production  first  article  WSP  systems  will  be 
installed  and  operated  at  each  site  under  a  test  NCP. 

4.5.3  Test  Sites. 

The  WSP  DT&E  testing  will  be  conducted  at  the  contractor's  facility  and  test  sites  as  designated 
by  the  government.  OT&E  testing  will  be  conducted  at  the  Technical  Center  and  the  first  key 
operational  site. 

4  5  4  Test  Support  Equipment. 

The  contractor  will  be  responsible  for  assuring  that  all  necessary  test  equipment  is  available  on 
time,  properly  calibrated,  and  fully  operational  to  support  all  tests.  Government  test  equipment 
may  be  utilized  where  Government  test  equipment  is  available  on  site  and  meets  all  specified  test 
equipment  requirements.  All  test  equipment  used  by  the  contractor  during  Factory  or  Site  Tests 
will  be  standard  commercial  equipment  and  will  not  be  modified.  All  test  equipment  will  operate 
in  the  manner  specified  by  the  test  equipment  manufacturer.  Use  of  custom  test  equipment  or 
modified  commercial  test  equipment  by  the  contractor  requires  approval  in  writing  by  the 
Contracting  Officer.  All  ancillary  equipment  required  by  the  contractor  for  test  purposes  will  be 
furnished  by  the  contractor  for  the  duration  of  the  tests.  The  Government  Team  Lead  for  Test 
may  require  the  contractor  to  recalibrate  any  test  equipment  provided  by  the  contractor  to  be  used 
in  the  test  program  due  to  the  following: 

a.  The  test  equipment  is  removed  from  the  test  setup  for  unrelated  purposes. 

b.  The  test  equipment  fails,  is  damaged,  or  appears  to  be  operating  in  a  faulty  manner 
based  on  Government  evaluation  of  test  results. 

In  addition  to  the  standard  contractor  supplied  equipment,  test  equipment  required  for  OT&E 
consists  of,  but  is  not  limited  to,  the  following: 

a.  Simple  Network  Management  Protocol  (SNMP)  NIMS  Simulator, 

b.  Anemometer  Simulator, 

c.  Weather  Scenario  Test  Tapes  (AOS-250), 

d.  Power  Monitor, 

e.  Protocol  Analyzer, 
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f  Oscilloscope,  ^ 

g.  Spectrum  Analyzer, 

h.  Signal  Generators, 

i .  Toshiba  T  ecra  Computer. 

4  6  TEST  CONFIGURATION  MANAGEMENT  (CM). 

The  WSP  contractor  will  maintain  a  CM  program  using  MIL-STD-973  as  guidance  on  all  project 
configuration  items.  The  contractor  will  provide  a  CM  Plan  that  documents  the  program 
procedures  and  responsibilities  including  baseline  identification,  control,  audit,  and  configuration 
status  accounting  of  hardware,  software,  firmware,  documentation,  and  support  equipment.  The 
CM  program  described  in  the  plan  will  ensure  positive  control  of  the  configuration  of  the  WSP 
equipment  and  documentation  throughout  the  life  of  the  contract. 

5  TEST  AND  EVALUATION  PROGRAM  DESCRIPTION. 


The  WSP  System  Test  program  will  ensure  that  the  WSP  fulfills  the  MNS,  the  RD,  NAS 
requirements,  and  the  FAA  System  Specification,  and  operates  effectively  when  integrated  into 
the  NAS.  The  WSP  System  Test  program  will  address  the  following  general  objectives; 

a.  Verify  that  contractor  testing  is  adequately  planned  and  successfully  implemented, 

b.  Verify  that  contractor  deliverables  meet  required  functional  and  performance 
requirements, 

c  Resolve  COIs  through  test  and  evaluation, 

d.  Resolve  the  NAS,  RD,  and  FAA  requirements  identified  in  the  VRTM, 

e.  Support  acquisition  and  life  cycle  planning  and  decision-making. 

The  WSP  System  Test  program  is  comprised  of  the  following  components  which  are  discussed  in 
further  detail  in  the  following  sections; 

a.  DEMVAL, 

b.  DT&E, 

c.  OT&E, 

d.  PAT&E, 

e.  Field  Familiarization. 

DEMVAL  testing  is  designed  to  reduce  and  quantify  risk  associated  with  the  WSP  program. 
DEMVAL  testing,  conducted  by  MIT/LL  on  the  TRDF  in  Albuquerque,  New  Mexico,  will 
continue  through  the  deployment  of  the  first  production  system. 

DT&E  testing  is  designed  to  verify  system  compliance  with  all  applicable  requirements,  and 
consists  of  informal  DQT,  FQT,  and  First  Article  Testing.  The  contractor  will  conduct  and  the 
Government  will  witness  DT&E  tests. 
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OT&E,  conducted  by  the  ACT-320  test  team  using  FAA  Order  1810.4B  as  guidance,  will  be 
comprised  of  NAS  Integration,  Operational,  and  Shakedown  tests.  NAS  Integration  will  address 
the  NAS  system-level  testing  requirements  in  accordance  with  NAS-SS-1000  to  ensure  that  the 
system  will  operate  and  be  compatible  with  the  NAS  environment.  Operational  testing  will 
provide  feedback  concerning  the  overall  operational  effectiveness  and  suitability  of  the  WSP  in  the 
total  NAS  environment,  and  will  focus  on  the  actual  operation  and  maintenance  of  the  system. 
Shakedown  testing  will  determine  the  overall  readiness  of  the  WSP  as  part  of  the  NAS  by 
exercising  the  system  in  an  operational  environment. 

PAT&E  testing  is  designed  to  ensure  the  system’s  functional  operation  and  verify  that  it  conforms 
to  applicable  specifications,  is  free  from  manufacturing  defects,  and  is  substantially  identical  to  the 
qualified  hardware.  The  contractor  will  conduct  and  the  Government  will  witness  PAT&E  tests 
on  each  production  system.  PAT&E  testing  consists  of  FAT  and  SAT. 

Field  Familiarization  is  conducted  at  each  WSP  site  by  regional  Airways  Facility  and  AT 
personnel.  It  is  conducted  in  an  operational  environment  to  support  determination  that  the  WSP 
is  ready  for  full  operation  as  part  of  the  NAS.  Field  Familiarization  occurs  after  contractor- 
conducted  site  acceptance  testing. 

5. 1  COMPLETED  DEMVAL  TESTING. 

DEMVAL  testing  of  the  engineering  prototype  WSP  has  been  conducted  at  Huntsville,  Alabama; 
Kansas  City,  Missouri;  Orlando,  Florida;  and  Albuquerque,  New  Mexico. 

The  1 990  DEMVAL  of  the  engineering  prototype  WSP  was  performed  by  MIT/LL  in  Orlando, 
Florida.  The  WSP  test  bed  used  during  this  evaluation  was  an  ASR-8  modified  to  emulate  the 
essential  features  of  an  ASR-9.  This  1990  evaluation  was  the  first  evaluation  of  ASR  derived 
wind  shear  products  in  an  operational  setting.  Five  distinct  products  were  provided:  microburst 
detection,  gust  front  detection,  gust  front  movement  prediction,  precipitation  reflectivity,  and 
storm  motion.  The  objectives  of  the  evaluation  were  to  provide  a  quantitative  assessment  of  the 
performance  of  the  signal  processing  and  wind  shear  detection  algorithms  in  the  wet,  convectively 
unstable  environment  of  the  Florida  peninsula,  and  to  obtain  feedback  from  users  (air  traffic 
controllers  and  supervisors).  The  first  objective  was  achieved  by  recording  wind  shear  products 
generated  by  the  WSP  during  the  operational  test,  and  then  correlating  them  with  observations 
from  other  meteorological  sensing  systems  (two  Doppler  C-band  weather  radars).  The  detection 
probabilities  for  moderate  to  strong  microbursts  (greater  than  1 5  meters  per  second  (m/s) 
measured  loss)  were  consistent  with  previous  analyses  of  WSP  performance  in  the  southeastern 
United  States,  indicating  that  the  high-reflectivity  outflows  characteristic  of  this  environment 
could  be  reliably  detected.  Microburst  false-alarm  probabilities  were  acceptable,  although  higher 
than  expected  from  earlier  measurements.  Comments  noted  by  TRACON  and  tower  observers 
indicated  an  overall  satisfaction  with  the  WSP  gust  front  detection  capability.  Supervisors  found 
the  product  to  be  a  valuable  aid  in  coordinating  air  and  ground  traffic  in  anticipation  of  airport 
runway  reconfigurations.  Algorithm  parameter  and  code  modifications  were  necessary  during  the 
operational  period  to  alleviate  unanticipated  false  declaration  problems;  as  a  result,  algorithm 
performance  improved.  The  second  objective  was  achieved  by  having  MIT/LL  observers 
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stationed  in  the  tower  cab  and  TRACON  during  the  test  period  and  by  means  of  questionnaires 
distributed  to  controllers  and  supervisors  at  the  conclusion  of  the  test  period.  Air  traffic 
controllers  and  their  supervisors  provided  a  generally  favorable  assessment  of  the  system.  During 
periods  when  weather  impacted  airport  operations,  the  MIT/LL  observers  in  the  tower  noted 
intense  interest  by  controllers  and  supervisors  in  the  information  being  presented  on  the  GSD. 
Overall,  the  1990  DEMVAL  established  that  the  WSP  could  enhance  the  safety  and  efficiency  of 
AT  operations. 

During  the  summer  of  1991,  testing  of  the  prototype  WSP  continued,  but  due  to  the  lack  of 
weather  no  report  was  generated  concerning  the  data  collected. 

The  1992  DEMVAL  of  the  engineering  prototype  WSP  was  also  performed  by  MIT/LL  in 
Orlando.  The  objective  of  the  evaluation  was  to  obtain  air  traffic  controller  reaction  to  the 
engineering  prototype  WSP  weather  data  and  display  equipment.  Questionnaire  forms  were  used 
to  obtain  responses  from  supervisors  and  controllers  relative  to  the  operational  suitability  of  the 
displays  and  data.  The  1992  DEMVAL  provided  significant  input  on  the  operational  suitability  of 
the  RDT  and  GSD,  and  usefulness  of  the  weather  products  provided  by  the  system  in  an 
operational  environment.  The  system  was  very  useful^  the  completeness,  timeliness,  and 
usefulness  of  the  displayed  information  for  gust  fronts  and  microbursts  and  the  clarity  of  the 
displayed  RDT  information  was  good.  In  addition,  supervisors  found  the  GSD  very  helpful  in 
making  runway  configuration  changes  prior  to  weather  events.  There  was,  however,  a  feeling 
that  the  system  produced  a  high  amount  of  false  alarms,  especially  gust  front  false  alarms.  ACT- 
320  recommended,  in  their  published  report,  that  micfoburst  and  gust  front  algorithm  refinement 
and  additional  testing  be  performed  to  better  meet  the  needs  of  the  users.  This  report,  titled 
“Final  Report  for  ATC  Evaluation  of  the  Prototype  ASR-WSP  at  Orlando  International  Airport,” 
dated  March  1993,  is  available  from  ACT-320  at  the  Technical  Center. 

The  1993  DEMVAL  of  the  prototype  WSP  was  performed  at  the  Albuquerque  International 
Airport.  Unlike  Orlando,  Albuquerque  provided  a  dry  environment  in  which  to  test  the 
algorithms.  The  objective  of  the  evaluation  was  to  obtain  air  traffic  controller  reaction  to  the 
engineering  prototype  WSP  weather  data  and  display  equipment.  Again,  questionnaire  forms 
were  used  to  obtain  responses  from  supervisors  and  controllers  relative  to  the  operational 
suitability  and  effectiveness  of  the  displays  and  data.  The  1993  DEMVAL  provided  significant 
input  on  the  operational  suitability  of  the  GSD  and  RDT,  and  usefulness  of  the  weather  products 
provided  by  the  system  in  an  operational  environment.  Generally,  the  controllers  felt  that  the 
WSP  system  was  a  significant  improvement  over  the  LLWAS  and  ASR-9  weather  channel  for 
ease  of  analyzing  and  broadcasting  severe  weather  products  to  pilots.  Supervisors  found  the  GSD 
very  helpful  in  making  runway  configuration  changes  prior  to  weather  events.  The  displayed 
information  for  both  microburst  alerts  (MBA)  and  wind  shear  alerts  (WSA)  and  the  clarity  of  the 
displayed  GSD  and  RDT  information  were  rated  very  good.  The  evaluation  of  the  RDT  display 
information  was  inconclusive,  possibly  due  to  the  limited  opportunities  for  the  user  participants  to 
observe  wind  shear  alerts  during  the  evaluation.  ACT-320  recommended,  in  their  published 
report,  that  evaluations  of  the  WSP  continue  at  Albuquerque  in  order  to  obtain  more  data  on  dry 
microbursts  and  wind  shear  information.  This  report,  titled  OT&E  ATC  Evaluation  for  the 
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Prototype  WSP  at  Albuquerque  International  Airport,”  dated  March  1994,  is  available  from  ACT- 
320  at  the  Technical  Center. 

Less  formal  evaluations  of  operational  effectiveness  were  conducted  by  MIT/LL  following  1994 
and  1 995  Albuquerque  summer  demonstrations.  Each  of  these  evaluations  solicited  feedback 
from  air  traffic  controllers  and  supervisors  on  the  operational  suitability  of  the  WSP  and  benefits 
realized  through  utilization  of  its  products.  Controllers  valued  the  advanced  warning  of  possible 
impact  of  weather  on  terminal  flight  routes  and  the  ability  to  plan  accordingly. 

The  1996  DEMVAL  of  the  prototype  WSP  was  conducted  in  Albuquerque  to  demonstrate  that 
the  required  WSP  hardware  interfaces  would  not  adversely  affect  the  operation  of  the  ASR-9 
target  channels  or  the  ability  to  certify  the  system.  In  addition,  the  1996  DEMVAL  was 
conducted  to  determine  the  differences,  if  any,  in  performance  between  the  WSP-equipped  ASR-9 
channel  and  a  normally  configured  ASR-9  channel;  this  was  accomplished  via  a  preliminary  flight 
inspection.  It  was  concluded  that  the  introduction  of  WSP  hardware  into  the  RF  path  of  the 
ASR-9  did  not  significantly  affect  target  detection  performance  of  the  radar.  Target  detection 
performance  comparisons  of  a  normally  configured  ASR-9  channel  versus  a  WSP-modified  ASR- 
9  channel  were  nearly  identical  in  that  the  inner  and  outer  fringe  coverage  ranges  appeared  the 
same  for  both  channels.  MIT/LL  published  their  findings  in  a  memorandum  titled  “Evaluation  of 
the  Effects  of  the  Weather  Systems  Processor  (WSP)  Hardware  on  ASR-9  Performance,”  dated 
August  1996. 

DEMVAL  will  continue  in  Albuquerque  through  the  deployment  of  the  first  production  system. 
MIT/LL,  working  under  a  study  contract  with  Northrop  Grumman,  will  design,  develop,  and 
demonstrate  a  new  high  integrity  receiver  chain,  a  hardware/software  interface  for  ASR-9  6-level 
weather,  and  a  Remote  Monitoring  Infrastructure  and  man-machine  interface. 

5.2  COMPLETED  DT&E/PAT&E. 

No  DT&E  or  PAT&E  has  been  performed  on  the  WSP  to  date. 

5.3  COMPLETED  OT&E. 

Operational  Evaluations  were  conducted  during  DEMVAL  testing  in  Orlando  in  1990  and  1992, 
and  in  Albuquerque  in  1993.  The  1990  DEMVAL  established  that  the  WSP  could  enhance  the 
safety  and  efficiency  of  air  traffic  operations.  Air  traffic  controllers  and  their  supervisors  provided 
a  generally  favorable  assessment  of  the  system.  The  1992  and  1 993  DEMVALs  provided 
significant  input  on  the  operational  suitability  of  the  RDT  and  GSD,  and  usefulness  of  the  weather 
products  provided  by  the  system  in  an  operational  environment.  During  1 992,  the  users  found  the 
system  to  be  very  useful;  the  completeness,  timeliness,  and  usefulness  of  the  displayed  information 
for  gust  fronts  and  microbursts  and  the  clarity  of  the  displayed  RDT  information  was  good.  In 
addition,  supervisors  found  the  GSD  very  helpful  in  making  runway  configuration  changes  prior 
to  weather  events.  There  was,  however,  a  feeling  that  the  system  produced  a  high  amount  of  false 
alarms,  especially  gust  front  false  alarms.  During  1993,  the  controllers  felt  the  WSP  system  was  a 
significant  improvement  over  the  LLWAS  and  ASR-9  weather  channel  for  ease  of  analyzing  and 
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broadcasting  severe  weather  products  to  pilots.  Supervisors  found  the  GSD  very  helpful  m 
making  runway  configuration  changes  prior  to  weather  events.  However,  the  evaluation  of  the 
RDT  display  information  was  inconclusive,  possibly  due  to  the  limited  opportunities  for  the  user 
participants  to  observe  wind  shear  alerts  during  the  evaluation. 

ACT-320  conducted  some  WSP/ASR-9  integration  testing  in  late  1996  at  the  Technical  Center. 
Testing  was  conducted  to  measure  the  effects  to  the  ASR-9  coverage,  calibration,  alignments,  and 
induced  faults  when  WSP  RF  waveguide  was  added  to  the  ASR-9.  Before  and  after  the  addition 
of  the  WSP  hardware  to  channel  A  of  the  ASR-9,  baseline  measurements  from  the  ASR-9  system 
were  taken.  Analysis  indicated  a  0.5  decibel  (dB)  loss  in  the  low  beam  target  path  and  a  3  dB  loss 
in  the  high  beam  target  path  as  shown  by  the  low  and  high  beam  Minimum  Discernible  Signal 
(MDS)  and  noise  figure  degradation  in  channel  A.  These  losses  were  compensated  for  by  making 
firmware  (Erasable  Programmable  Read-Only  Memory  (EPROM))  changes  to  the  ASR-9.  In  a 
study  done  by  Northrop  Grumman,  low  and  high  beam  coverage  patterns  also  changed.  This  high 
beam  coverage  was  returned  to  normal  by  making  high  beam  STC  Variable  Site  Parameter  (VSP) 
changes  and  moving  the  high/low  beam  switching  point  VSPs.  A  comprehensive  report  was 
generated  and  submitted  to  the  WSP  PT.  Future  ACT-320  integration  testing  at  the  Technical 
Center  will  be  coordinated  with  the  AND-410  ASR-9  Technical  Officer. 

■5  4  DT&E  TESTING. 

DT&E  will  be  conducted  at  the  contractor’s  facility  and  encompasses  hardware,  software,  system 
testing,  test  reports,  and  Functional  Configuration  Audit/Physical  Configuration  Audit 
(FCA/PCA).  DT&E  will  be  conducted  by  the  contractor  using  FAA-approved  test  procedures, 
and  will  be  monitored  by  the  WSP  PT.  The  contractor  is  responsible  for  timely  and  satisfactory 
completion  of  testing  in  accordance  with  the  approved  schedule. 

The  contractor  will  develop  and  provide  test  procedures  for  each  test  and  evaluation  activity 
identified  in  the  CMTP  and  the  DT&E  Plan.  Procedures  will  be  written  for  all  test, 
demonstration,  analysis,  and  inspection  requirements.  Requirements  verified  through  analysis, 
such  as  reliability,  will  include  detailed  information  regarding  vendor’s  data.  Procedures  will 
include  required  personnel,  test  support  equipment,  test  configuration,  schedule,  location,  success 
criteria,  and  expected  results.  A  VRTM  which  maps  contract  requirements  will  be  developed. 

No  formal  testing  will  commence  until  the  procedures  have  been  reviewed  and  approved  by  the 
WSP  PT. 

The  contractor  will  provide  test  reports  for  all  completed  tests  as  directed  by  the  SOW.  The  test 
report  will  describe  evaluation  criteria,  results,  and  all  relative  supporting  material.  The  reports 
will  be  approved  by  the  WSP  PT  prior  to  the  commencement  of  OT&E. 

DT&E  consists  of  DQT,  FQT,  and  First  Article  Testing.  DQT  will  incrementally  demonstrate 
that  the  engineering  design  and  development  are  complete,  that  design  risks  have  been  minimized, 
and  that  the  system  meets  WSP  design  and  performance  specifications.  FQT  is  formal 
qualification  testing  conducted  by  the  contractor  to  verify  that  the  implemented  hardware  and 
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software  design  meets  the  functional  and  performance  requirements  of  the  WSP  System 
Specification. 

First  Article  Testing  is  testing  conducted  on  the  first  system(s)  built  by  the  contractor,  and 
consists  of  FAT,  SAT,  and  Delta  DT&E  Tests.  FAT  is  conducted  by  the  contractor  at  the  factory 
for  each  delivered  item  to  verify  that  it  conforms  to  applicable  specifications,  is  free  from 
manufacturing  defects,  and  is  substantially  identical  to  the  qualified  hardware.  SAT  is  conducted 
by  the  contractor  at  each  field  site  before  acceptance  by  the  FAA. 

Delta  DT&E  tests  those  requirements  that  require  a  NAS  operational  environment  (e  g.,  stress, 
loading,  or  weather  conditions)  or  NAS  equipment  (interfacing  subsystems)  not  available  at  the 
contractor's  facility,  and  will  be  conducted  at  the  Technical  Center  and/or  the  key  site(s).  Delta 
DT&E  consists  of  system  reliability,  maintainability,  algorithm  implementation,  weather,  72-hour 
continuous  operation,  alignment,  and  interface  demonstrations.  Results  for  all 
tests/demonstrations  will  be  contained  in  the  FAA-approved  DT&E  Report. 

5.4. 1  Reliability  Program. 

The  contractor  will  maintain  and  demonstrate  a  reliability  program  in  accordance  with  contract 
requirements.  The  contractor’s  overall  methodology  for  conducting  a  reliability  program  and 
reliability  predictions  will  be  documented  in  a  Reliability  Program/Demonstration  Plan.  These 
reliability  predictions  will  be  based  on  data  collected  from  the  First  Article  systems. 

5.4.2  Maintainability  Program. 

The  contractor  will  maintain  and  demonstrate  a  maintainability  program  in  accordance  with 
contract  requirements.  The  contractor’s  overall  methodology  for  conducting  a  maintainability 
program  will  be  documented  in  a  Maintainability  Program/Demonstration  Plan. 

5  4.3  Algorithm  Implementation  Demonstration. 

The  contractor  will  demonstrate  that  the  software  used  to  implement  the  GFP  meteorological 
algorithms  is  correct.  GFP  base  data  will  be  used  as  test  data  and  the  resulting  algorithm  outputs 
will  be  compared  with  corresponding  Government  supplied  correct  outputs.  The  results  of  this 
comparison  will  be  analyzed  to  determine  the  performance  of  the  software  system  on  the  test  data 
cases. 

5  4  4  Weather  Demonstration. 

The  contractor  will  conduct  an  end-to-end  system  demonstration  using  Government  Furnished 
Information  (GFl)  time-series  weather  data  sets.  All  weather  processing,  weather  reporting 
functions,  and  associated  specification  performance  parameters  and  tolerances  will  be  met  and 
demonstrated. 
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5. 4. 5  72-Hour  Continuous  Operation  Demonstration. 

The  contractor  will  conduct  a  72-hour  continuous  operation  field  demonstration  on  all  First 
Article  systems  to  demonstrate  compliance  with  requirements.  During  this  test,  the  WSP  system 
will  meet  all  specification  requirements  without  failure  of  hardware  or  software.  Any  failure  will 
require  a  rerun  of  the  demonstration  once  the  failure  is  remedied.  Any  failure  of  the  ASR-9 
system  not  attributable  to  the  WSP  will  not  be  scored  against  the  WSP. 

5.4.6  Alianment  Demonstration. 

The  WSP  will  be  completely  aligned  utilizing  only  the  procedures  and  test  equipment  cited  in  the 
instruction  manuals.  Verification  and  validation  testing  will  be  performed  to  determine  the 
adequacy  of  techniques,  technical  manuals,  and  test  equipment. 

5.4  7  Interface  Demonstration. 

The  contractor  will  demonstrate  that  the  WSP  system  can  interface  and  operate  compatibly  with 
all  external  and  internal  interfaces  defined  in  the  system  specification. 

5  5  OT&E  TESTING. 

The  following  provides  an  overview  of  the  OT&E  test  strategy  to  satisfy  NAS  operational 
requirements.  OT&E  will  identify  deficiencies  in  hardware,  software,  human  performance  factors, 
and  operational  concepts,  and  will  encompass  an  interactive  process  of  risk  reduction 
demonstrations  and  analyses  to  ensure  NAS  functionality  (as  it  existed  prior  to  installation  of  the 
new  subsystem)  is  not  degraded.  OT&E  will  consist  of  three  phases  -  Integration,  Operational, 
and  Shakedown. 

Successful  completion  of  OT&E  will  resolve  the  COIs  identified  in  section  3  and  satisfy  the 
requirements  identified  in  the  VRTM  in  section  appendix  A.  Various  FAA  organizations,  regions, 
and  sectors  will  support  OT&E  test  activities  as  specified  in  section  4  of  this  document. 

5.5.1  Integration  Testing. 

Integration  testing  will  ensure  the  successful  integration  of  the  WSP  into  the  FAA  NAS.  The 
WSP  must  be  operationally  integrated  with  other  operational  systems  used  by  the  AT  community. 
Testing  will  include  subsystem  integration  (Base  Data  Display,  Maintenance  Display  Terminal, 
etc  ),  system  integration  (ASR-9,  NIMS,  etc.),  and  end-to-end  performance  to  ensure  all  system 
interfaces  are  compatible  and  that  WSP  product  information  and  system  maintenance  information 
are  properly  displayed. 

Integration  requirements  are  derived  from  the  WSP  System  Specification,  the  WSP  RD,  and 
NAS-SS-1000,  and  are  included  in  the  VRTM.  ACT-320  has  determined  the  methodology  for 
testing  these  requirements. 
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5.5. 1  ■  1  Subsystem  Integration. 


ACT-320  will  conduct  subsystem  integration  tests  to  verify  that  the  internal  ,  interfaces  of  the  WSP 
function  according  to  specifications.  WSP  internal  interfaces  include  the  Base  Data  Recorder,  the 
BDD,  the  Times  Series  Recorder,  the  MDT,  and  the  DFU  as  described  and  shown  in  figure  3.3-2. 

5. 5. 1.2  System  Integration. 

ACT-320  and  ACT-330  will  conduct  system  integration  tests  to  verify  that  the  external  interfaces 
of  the  WSP  meet  link  level  requirements  as  specified  in  the  WSP  System  Specification,  NAS-SS- 
1 000,  and  the  associated  Interface  Requirements  Document  (IRD)  and  Interface  Control 
Document  (ICD).  WSP  external  interfaces  include  the  ASR-9,  the  LLWAS  or  ASOS,  and  the 
NIMS  as  described  and  shown  in  figure  3.3-2. 

ACT-330  will  accomplish  WSP/NIMS  interface  testing  to  ensure  all  commands,  status  messages, 
and  alarms  function  in  accordance  with  approved  directives,  test  plans,  and  procedures.  Prior  to 
this  interface  testing,  ACT-330  may  also  conduct  NIMS  confidence  testing  ~  dry  run  testing  to 
evaluate  a  NIMS  module  designed  to  decode  the  WSP  RMF  information.  If  deficiencies  are 
discovered,  this  confidence  testing  will  be  followed  by  confidence  regression  testing  of 
contractor’s  fixes.  This  regression  testing  will  occur  prior  to  formal  WSP/NIMS  interface  testing. 

5.51  3  End-to-End  Performance. 

ACT-320  will  conduct  end-to-end  performance  tests  to  establish  a  system  baseline,  to  ensure  all 
system  interfaces  are  compatible,  and  to  ensure  that  WSP  product  information  and  system 
maintenance  information  are  properly  displayed. 

Included  as  part  of  these  performance  tests,  ACT-320  and  AOS-250  will  verify  that  the  GFP 
weather  algorithms  have  been  satisfactorily  implemented  by  the  contractor.  Base  data  will  be 
collected  at  operational  sites  (beginning  at  the  key  sites)  and  analyzed  to  determine  the 
algorithm’s  performance. 

5.5.2  Operational  Testing. 

ACT-320  will  develop  and  perform  operational  tests  on  the  WSP.  Operational  testing  will 
identify  deficiencies  in  hardware,  software,  human  performance  factors,  or  operational  concepts, 
including  supportability.  Testing  will  be  accomplished  at  the  Technical  Center  and  the  key  site(s) 
using  the  approved  FAA  OT&E  test  plans  and  procedures. 

Operational  testing  will  involve  field  maintenance  and  field  AT  personnel  as  an  integral  part  of  the 
test  effort.  The  test  team  will  include  a  WSP  (and/or  ASR-9)  maintenance  specialist  who  will 
actively  participate  as  a  member  of  the  test  team  with  specific  test  responsibilities.  Air  traffic 
controllers  will  be  actively  involved  in  the  hands-on  evaluation  of  the  WSP  equipment. 
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This  testing,  with  user  participation,  is  to  ensure  operational  requirements  are  met.  Aspects  of 
this  testing  include  the  following: 

a.  Reliability,  maintainability,  and  availability, 

b.  Degraded  operations, 

c.  Site  adaptation  and  optimization, 

d.  Human  factors, 

e.  Safety, 

f  Transition  switchover, 

g.  Security, 

h.  Stress  and  NAS  loading. 

Results  of  operational  testing  will  be  presented  in  the  WSP  OT&E  Final  Report. 

5.5.2. 1  Reliability. 

ACT-320  will  review  reliability  (failure)  data  collected  during  DT&E  to  perform  a  trend  analysis. 
A  failure  will  be  scored  as  a  relevant  or  nonrelevant  failure  (not  inherent  to  the  equipment).  The 
trend  analysis  will  be  used  to  predict  system  reliability  to  the  configuration  item  level.  Failure  rate 
analysis  will  be  based  on  actual  operational  experience,  test  data,  experience  with  similar  systems, 
and  manufacturer  specifications.  After  reviewing  data,  ACT-320  will  determine  if  additional 
reliability  testing  is  required  during  OT&E. 

5. 5. 2. 2  Maintainability. 

A  maintainability  test  will  be  conducted  by  ACT-320  at  the  Technical  Center.  This  test  will  use 
procedures  taken  from  the  maintenance  manuals  developed  by  the  contractor.  Field  maintenance 
personnel  trained  on  the  WSP  and  ASR-9  will  assist  with  this  test. 

5. 5.2.3  Availability. 

Failure  data  and  maintenance  test  results  will  be  used  in  computing  WSP  system  availability. 

5. 5. 2.4  Degraded  Operations. 

ACT-320  will  determine  the  acceptability  of  the  WSP  responses  and  resulting  operational  impacts 
when  failures  are  induced  into  the  system.  Failures  may  include  communication  link  disruptions, 
processor  malfunctions,  host  radar  problems,  etc. 

5. 5. 2.5  Site  Adaptation  and  Optimization. 

OT&E  will  verify  that  the  WSP  is  adaptable  to  function  successfully  in  various  site  configurations. 
System  performance  should  not  be  adversely  impacted  by  the  altering  of  system  parameters  to 
meet  various  site  configurations.  ACT-320  and  AOS-250  will  verify  these  adaptable  parameters 
and  perform  system  optimization  at  all  test  sites. 
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5.5. 2. 6  Human  Factors. 


ACT-320  and  human  factors  personnel  will  assess  the  usability  and  impact  of  new  products  (AP- 
corrected  six-level  weather)  only.  These  products  will  be  displayed  on  the  users’  DBRITE  and 
DEDS  displays.  (Human  factors  evaluations  were  conducted  during  DEMVAL  testing  and  are 
discussed  in  sections  5.1  and  5.3.  Specifically,  users  were  asked  to  evaluate  the  usability  of 
existing  DFUs  (GSDs  and  RDTs)  and  products  (microbursts,  gust  fronts,  etc.).) 

5.52.1  Safety. 

A  safety  inspection  will  be  conducted  by  qualified  personnel  to  ensure  that  the  WSP  subsystem  is 
in  conformance  with  FAA  Order  3900. 19A,  Occupational  Safety  and  Health. 

5. 5. 2. 8  Transition  Switchover. 

ACT-320  will  assess  the  ease  of  transition  from  the  standard  ASR-9  6-Ievel  weather  receiver  to 
the  ASR-9  with  the  WSP  receiver,  the  transition  from  the  existing  wind  shear  detection  system  to 
the  WSP  system,  etc.  This  assessment  will  be  conducted  at  the  key  site(s)  and  will  benefit  later 
site  installations. 

5. 5. 2.9  Security. 

A  Security  inspection  or  analysis  will  be  conducted  by  qualified  personnel  to  ensure  that  the  WSP 
is  in  conformance  with  FAA  Order  1600.54,  FAA  Automated  Information  Systems  Security 
Handbook. 

5.5.2.10  Stress  and  NAS  Loading. 

ACT-320  will  estimate  and  determine  the  acceptable  WSP  capabilities  and  reactions  to  the  levels 
of  stress  and  NAS  loading  provided  by  the  operational  environment. 

5. 5. 3  Shakedown  Testing. 

Shakedown  testing  will  determine  the  overall  readiness  of  the  WSP  as  part  of  the  NAS  through 
exercising  the  system  in  an  operational  environment.  This  will  include  testing  to  confirm  that 
when  the  WSP  is  operated  and  maintained  by  operational  personnel,  all  requirements  are  met. 
Shakedown  testing  will  verify  the  effectiveness,  suitability,  maintainability,  supportability,  and 
integration  requirements  of  the  system. 

Shakedown  testing  will  be  conducted  at  the  Technical  Center,  key  site(s),  and  First  Article  sites 
by  hardware  and  software  engineers,  meteorologists,  and  technicians  from  ACT-320,  AOS-250, 
AOS-270,  and  various  FAA  Regions. 
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5.5.3. 1  Effectiveness. 


The  WSP  will  be  assessed  regarding  potential  system  effectiveness  in  providing  reliable  service. 

5. 5. 3. 2  Suitability. 

This  assessment  will  determine  the  suitability  of  the  display  information  and  system  response. 

5. 5. 3. 3  Maintainability. 

In  addition  to  the  operational  maintainability  testing,  this  assessment  will  evaluate  Technical 
Instruction  Books  for  completeness  and  clarity  and  will  evaluate  the  WSP’s  capability  to 
accurately  present  system  status  to  the  user. 

5. 5. 3.4  Supportabilitv. 

This  assessment  will  determine  if  WSP  documentation  is  readily  available  and  current.  In 
addition,  this  assessment  will  establish  the  FAA’s  capability  to  support  field  activities  from  a  total 
system  perspective  and  will  include  hardware  and  software  maintenance  and  configuration 
management. 

5. 5. 3. 5  System  Integration. 

Shakedown  system  integration  testing  will  assess  the  WSP  operation  and  determine  any  negative 
impact  on  the  existing  ATC  system.  Testing  will  encompass  all  internal  and  external  interfaces. 

5  6  PAT&E  TESTING. 

The  contractor  will  conduct  PAT&E  on  each  production  unit  to  verify  that  the  product  conforms 
to  applicable  specifications,  is  free  from  manufacturing  defects,  and  is  substantially  identical  to  the 
qualified  hardware.  These  tests  will  be  conducted  in  accordance  with  the  FAA-approved  PAT&E 
test  plans  and  procedures. 

PAT&E  will  consist  of  FAT  and  SAT.  PAT&E  FAT  will  be  conducted  on  each  production  item 
by  the  contractor  at  their  factory  to  verify  that  it  conforms  to  applicable  specifications  and 
requirements.  A  limited  subset  of  Delta  DT&E  First  Article  Tests  will  be  performed  on  each 
PAT&E  FAT  article.  Successful  completion  of  PAT&E  FAT  represents  a  partial  FAA 
acceptance  of  the  production  article.  PAT&E  SAT  will  be  conducted  on  each  delivered  item  to 
verify  the  effective  installation  of  the  WSP  into  each  facility  and  to  verify  the  suitability  of  the 
system  for  FAA  OT&E.  Again,  a  limited  subset  of  Delta  DT&E  First  Article  Tests  will  be 
performed  on  each  PAT&E  SAT  article. 
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5.7  FIELD  FAMILIARIZATION. 


Field  familiarization  testing,  formerly  referred  to  as  Field  Shakedown  testing,  will  be  conducted  by 
AF  and  AT  field  personnel  following  site  acceptance  testing  at  each  field  site.  During  field 
familiarization,  site  personnel  will  become  familiar  with  the  WSP  and  confirm,  via  site  specific 
testing,  that  the  WSP  is  properly  configured  and  integrated  to  allow  the  transition  into  the  NAS. 
Support  for  field  familiarization  will  be  provided  by  the  Integrated  Product  Team  (IPT)  as 
required.  Once  field  familiarization  has  been  completed  to  the  satisfaction  of  field  personnel,  the 
WSP  will  be  ready  for  commissioning. 
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6.  ACRONYMS. 


A 

Analysis 

ACP 

Azimuth  Change  Pulse 

A/D 

Analog  to  Digital 

ADP 

Automatic  Data  Processing 

AF 

Airway  Facilities 

AGL 

Above  Ground  Level 

AMS 

Acquisition  Management  System 

AP 

Anomalous  Propagation 

APML 

Associate  Program  Manager  for  Logistics 

ARIG 

Acquisition  Reform  Interim  Guidance 

ARP 

Airport  Reference  Point 

ARTS 

Automated  Radar  Terminal  System 

ASOS 

Automated  Surface  Observing  System 

ASP 

Acquisition  Strategy  Paper 

ASR 

Airport  Surveillance  Radar 

AT 

Air  Traffic 

ATC 

Air  Traffic  Control 

ATCT 

Air  Traffic  Control  Tower 

BDD 

Base  Data  Display 

BIT 

Built-In  Test 

CAl 

Contractor  Acceptance  Inspection 

CDRL 

Contract  Data  Requirements  List 

CFR 

Code  of  Federal  Regulations 

CM 

Configuration  Management 

CMTP 

Contractor's  Master  Test  Plan 

COHO 

Coherent  Oscillator 

COI 

Critical  Operational  Issue 

COTS 

Commercial-off-the-Shelf 
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CP 

Circular  Polarization 

CPP 

Critical  Performance  Parameters 

CPU 

Central  Processing  Unit 

CSCl 

Computer  Software  Configuration  Items 

D 

Demonstration 

dB 

Decibel 

DBRITE 

Digital  Bright  Radar  Indicator  Tower  Equipment 

DEDS 

Data  Entry  and  Display  System 

DEMVAL 

Demonstration  Validation 

DF 

Display  Function 

DFU 

Display  Functional  Unit 

DQT 

Design  Qualification  Testing 

DT&E 

Development  Test  and  Evaluation 

EXCOM 

Executive  Committee 

EY 

Employee  Year 

FAA 

Federal  Aviation  Administration 

FAT 

Factory  Acceptance  Test 

FCA 

Functional  Configuration  Audit 

FIT 

Fault  Isolation  Test 

FQT 

Formal  Qualification  Test 

ft 

Feet 

FY 

Fiscal  Year 

GFD 

Government  Furnished  Data 

GFP 

Government  Furnished  Property 

GMT 

Greenwich  Mean  Time 

GSD 

Geographic  Situation  Display 

I 

Inspection 

I&Q 

In-Phase  and  Quadrature 

lAGC 

Instantaneous  Automatic  Gain  Control 

ICD 

Interface  Control  Document 
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lOT&E 

Operational  Test  and  Evaluation  Oversight 

IPP 

Integrated  Program  Plan 

IPT 

Integrated  Product  Team 

IRD 

Interface  Requirements  Document 

ISR 

In-Service  Review 

ITWS 

Integrated  Terminal  Weather  System 

JAI 

Joint  Acceptance  Inspection 

LAN 

Local  Area  Network 

LLWAS 

Low  Level  Wind  Shear  Alert  System 

LP 

Limited  Production 

LP 

Linear  Polarization 

m/s 

Meters  per  Second 

MBA 

Microburst  Alert 

MDT 

Maintenance  Data  Terminal 

MB 

Megabyte 

MHz 

Megahertz 

MIT/LL 

Massachusetts  Institute  of  Technology/Lincoln  Laboratory 

MNS 

Mission  Need  Statement 

MOE 

Measures  of  Effectiveness 

MOP 

Measure  of  Performance 

MOP 

Minimum  Operational  Performance 

MOS 

Measure  of  Suitability 

MTBF 

Mean  Time  Between  Failures 

MTBPMA 

Mean  Time  Between  Preventive  Maintenance  Actions 

MTR 

Mean  Time  To  Repair 

MTTR 

Mean  Time  To  Restore 

NAILS 

National  Airspace  Integrated  Logistics  Support 

NAS 

National  Airspace  System 

NCP 

NAS  Change  Proposal 

NDI 

Non-Developmental  Item 
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NIMS 

NAS  Infrastructure  Management  System 

NLT 

No  Less  Than 

ntni 

Nautical  Mile 

NWS 

National  Weather  Service 

ORD 

Operational  Readiness  Demonstration 

OT&E 

Operational  Test  and  Evaluation 

P'l 

Pre-Planned  Product  Improvement 

PAT&E 

Production  Acceptance  Test  and  Evaluation 

PCA 

Physical  Configuration  Audit 

PD 

Probability  of  Detection 

PD 

Program  Directive 

PFA 

Probability  of  False  Alarm 

PMR 

Program  Management  Review 

PT 

Product  Team 

RAM 

Random  Access  Memory 

RD 

Requirements  Document 

RDA 

Radar  Data  Acquisition 

RDP 

Radar  Data  Processor 

RDT 

Ribbon  Display  Terminal 

RF 

Radio  Frequency 

RMA 

Reliability,  Maintainability,  Availability 

RMF 

Remote  Monitoring  Function 

RMS 

Root  Mean  Square 

SAT 

Site  Acceptance  Testing 

SCIP 

Surveillance  Communication  Interface  Processor 

SNMPvl 

Simple  Network  Management  Protocol  Version  1 

SOW 

Statement  of  Work 

STALP 

Stable  Local  Oscillator 

STC 

Sensitivity  Time  Control 

STD 

Standard 
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STP 

Software  Test  Plan 

T 

Test 

T&E 

Test  and  Evaluation 

TBD 

To  Be  Determined 

TCP/IP 

Transport  Control  Protocol/Intemet  Protocol 

TDWR 

Terminal  Doppler  Weather  Radar 

TEMP 

Test  and  Evaluation  Master  Plan 

TMU 

Traffic  Management  Unit 

TPWG 

Test  Planning  Working  Group 

TRACON 

Terminal  Radar  Approach  Control 

TRDF 

Terminal  Radar  Development  Facility 

TRR 

Test  Readiness  Review 

TSSR 

Test  Schedule  Status  Review 

UTC 

Universal  Coordinated  Time 

VRTM 

Verification  Requirements  Traceability  Matrix 

VSP 

Variable  Site  Parameters 

WSA 

Wind  Shear  Alert 

WSP 

Weather  System  Processor 
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Appendix  A 

Verification  Requirements  Traceability  Matrix  (VRTM) 


VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  (VRTM). 


The  TEMP  VRTM  presents  high  level  test  requirements  that  are  to  be  verified  as  part  of  the 
OT&E  test  program.  The  WSP  requirements  are  based  on  NAS-SS-1000  Volume  1 ,  the  RD  for 
the  WSP,  and  the  WSP  System  Specification,  FAA-E-2917.  The  VRTM  also  includes  a  summary 
of  NIMS  functional  and  performance  requirements  from  the  NIMS  draft  specification, 
FAA-E-XXXX  (to  become  FAA-E-291 1  after  baselined). 

COLUMN  DEFINITIONS. 

The  following  is  an  explanation  of  terms  used  in  the  VRTM  table  header: 

Test  Descrtn  ID#  -  (Test  Description  Identification  Number)  -  Unique  test  identifier  assigned  for 
ease  and  consistency  of  reference  throughout  the  OT&E  test  program 

Reqs.  Para.  -  (Requirements  Paragraph)  -  Paragraph  number  from  a  particular  FAA  Document. 
Description  -  Describes  the  appropriate  test  requirement. 

DT&E  -  Development  Test  and  Evaluation 

PAT&E  -  FAT  -  Production  Acceptance  Test  and  Evaluation  -  Factory  Acceptance  Test 

PAT&E  -  SAT  -  Production  Acceptance  Test  and  Evaluation  -  Site  Acceptance  Test 

OT&E  -  Operational  Test  and  Evaluation  Integration,  Operational,  and  Shakedown 

SITE  LEVEL  -  This  level  of  verification  is  usually  performed  at  the  designated  site.  The 
verification  portion  of  the  subsystem  installation  and  checkouts  will  emphasize  the  demonstration 
of  the  overall  system  performance  requirements.  It  includes  the  demonstration  of  an  end-item, 
subsystem  and  or  system,  the  final  acceptance  demonstrations,  and  commissioning  activities.  All 
verification  levels  for  subsystem  to  facility  ihterfaces  would  normally  occur  at  installation  site. 

MAOR  -  Minimum  Acceptable  Operational  Requirements 

COI  -  MOE  -  MOS  -  MOP  Critical  Operational  Issue  -  Measure  of  Effectiveness  -  Measure  of 
Suitability  -  Measure  of  Performance 

VERIFICATION  METHODS  AND  DEFINITIONS 

Verification  methods  are  defined  as  follows: 

TEST  -  Method  of  verification  that  will  measure  equipment’s  performance  under  specific 
configuration-load  conditions  and  after  the  controlled  application  of  known  stimuli.  Quantitative 
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values  are  measured,  compared  against  previous  predicted  success  criteria  and  then  evaluated  to 
determine  degree  of  compliance. 

DEMONSTRATION  -  Method  of  verification  where  qualitative  versus  quantitative  validation  of 
a  requirement  is  made  during  a  dynamic  test  of  the  equipment.  Additional  definitions  state  that  if 
a  requirement  is  validated  by  test  during  first  article  testing  and  the  requirement  has  enough 
significance  that  it  is  “retested”  during  acceptance  test,  then  this  acceptance  testing  can  be 
indicated  in  the  VRTM  as  a  demonstration.  The  final  definition  states  that,  in  general,  software 
functional  requirements  are  validated  by  demonstration  since  the  functionality  must  be  observed 
through  some  secondary  media. 

ANALYSIS  -  Method  of  verification  comparing  hardware  or  software  design  with  known 
scientific  and  technical  principles,  technical  data,  or  procedures  and  practices  to  validate  that  the 
proposed  design  will  meet  the  specified  functional  or  performance  requirements. 

INSPECTION  -  Method  of  verification  to  determine  compliance  with  specification  requirements 
and  consists  primarily  of  visual  observations,  or  mechanical  measurements  of  the  equipment, 
physical  locations,  or  technical  examination  of  engineering-support  documentation. 
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WSP  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  (VRTMV 
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Verification  Methods;  T  »  Test,  D  «  Demonstration,  A  ^  Analysis,  I «  Inspection,  X  =  Not  Applicable,  *  «  Test  using  Canned  Data,  **  -  The  Reliability  Demonstration 
shall  use  reliability  data  collected  during  testing  and  shall  Include  a  72-hour  **hands-ofr’  demonstration  test,  #  OT&E  Includes  Integration,  Operational,  and 
Shakedown  testing 
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Vermcatton  Mettiods:  T  «  Test,  D  ■  Demonstration,  A  *  Analysis,  I  =  Inspection,  X  »  Not  Applicable,  *  *  Test  using  Canned  Data,  **  *  The  Reliability  Demonstration 
shall  use  rettablllty  data  collected  during  tesdng  and  shall  Inetude  a  724iour  ^hands-off”  demonsb-ation  test,  #  OT&E  Includes  Integradon,  Operattonal,  and 
Shakedown’ testing 
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Verification  Methods:  T  =  Test,  D  =  Demonstration,  A  »  Analysis,  I  ^  inspection,  X  «  Not  Applicable,  *  s  Test  using  Canned  Data,  ^  -  The  Reliability  Demonstration 
shall  use  reliability  data  collected  during  testing  and  shall  Include  a  72-hour  ‘‘hands-off"  demonstration  test,  #  OT&E  includes  Integration,  Operational,  and 
Shakedown  testing 


Veririca^  Methods:  T  »  Test,  D  =  Demonsh-atlon,  A  «  Analysis,  I  *  Inspection,  X  »  Not  Applicable,  *  =  Test  using  Canned  Data,  =  The  Relfal^llty  Demonsti'ation 
shall  use  reHablltty  data  collected  during  testing  and  shaH  Include  a  724iour  **hands-ofr’  demonstiation  test,  #  OT&E  Includes  ht^ratton.  Operational,  and 
Shakedown  testing 


c 

o 

;p 

c 

E  c 
«  <0 
o  ^ 

l§ 

^  ’S 

n  <9 
JS  hm 

»  . 
f  § 
“  s 

if 

O  M 

•a  ^ 

ll 

gg 

O  * 

P«UJ 


So 
S  ^ 

iT  « 
r-  ^ 

tl  ♦- 

'4 

=;  c 
a.  o 

<  g 
z  r 


I 


X  m 


o  S 

»  r 

S  h 

a>  3 

ll 

r  N 


«  « 
*ss  ^ 

II  ^ 

<  •* 

§1 


ll 

gii 

i  ? 


1 

1 

1 

1 

1 

1 

1 

1 

1 

i 

h- 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

g(v40 
•  44 

■ 

1 

X 

X 

o 

■ 

X 

■ 

1 

X 

O 

o 

o 

o 

o 

X 

X 

o 

D 

o 

o 

o 

o 

o 

o 

O 

o 

o 

a 

o 

o 

o 

13k  - 

i 

1 

X 

X 

X 

■ 

X 

X 

1 

X 

X 

X 

X 

X 

X 

X 

X 

1*  : 

■ 

■ 

■ 

■ 

■ 

■ 

X 

1 

X 

X 

X 

X 

X 

X 

X 

X 

if  . 

Q 

o 

■ 

o 

o 

Q 

o 

o 

Q 

o 

o 

o 

o 

D 

o 

o 

o 

1 

o 

ce 

1 

60 

e 

1 

1 

a 

J 

1 

2 

S  t> 

Xi  V 

ll 

1 1 

G  » 

O  o 

2-S 

B 

1 

.o 

1 

m 

B 

*€ 

u 

2 

M 

2 

3 

1 

O 

G 

O 

1 

>% 

1  ^ 

I  ^ 

M  t 

8  S 
I'S 

1  i 

S  9 

cao 
e  ^ 

O  3 

s  s 

1 

1“ «, 

« § 
ll 

1  e 

2  E 

2  ^ 

8  S 

•Ss  (M 

3  O 

1  § 

J  i 

Si 

Si 

2  S 

Cm 

o 

•i 

g 

60 

•1 

C  CQ 

1  § 

«  8 

V  m 

3  g 
rS  to 

1  ^ 

•s  ^ 

S  J 

1 

tn 

Cm 

O 

■1 

1 

% 

tJ 

2  S 
*«  P 

2  3 

3  O 

11 

’ll 

2  S 

1. 

o-.s 

mI 

3  S 

8  ^ 

'£  p 

s  1 
11 

1 J 

3  O 

JD  t> 

1  *^3 

ll 

O  M 

2  8 

1 

1 

1 

9 

tn 

1 

1 

'i 

«s 

1 

■§ 

2 

I 

1 

1 

1 

S 

1 

s 

1 

2 

& 

t 

3 

1 

Cm 

o 

1 

1 

s 

§ 

2 

3 

1 

1 

& 

Vi 

1 

CO 

8 

1 

c 

-a 

5 

1 

M 

'o 

& 

1 

o 

Vi 

1 

60 

G 

1 

<g 

^1 

s 

i 

'© 

B 

O 

lA 

1 

60 

C 

1 

I  a 

t  g 

II 

1 

V 

Cm 

O 

8> 

5 

M 

o 

Vi 

1 

60 

.S 

ts 

1 

6 

Is 

ll 
&  .£ 

1 

fe* 

3 

05 

Cm 

O 

& 

S 

u 

ee 

1 

60 

C 

1 

L 

11 

V  3 

0^  «S 

g) 

5 

O 

Vi 

1 

60 

.£ 

1 

1 

1 

6 

1 

1 

1 

a> 

Pi 

& 

s 

o 

1 

3 

60 

ta 

i 

1 

«> 

60 

1 

o 

1 

60 

G 

1 

M 

3 

1 

1 

lis 

:  ri 
.  rn 

eo 

rn 

JB 

ri 

rn 

rsj 

fO 

'■T' 

ri 

■ 

1 

S 

ri 

m 

G 

ri 

fn 

m 

fS 

<N 

fn 

x> 

oi 

ri 

rn 

u 

<N 

<N 

rn 

•3 

<N 

<N 

rn 

o 

ri 

fS 

rn 

Cm 

r>i 

<N 

60 

fS 

ri 

rn 

■ 

:  <h 

z  o 

1 

W 

z  c 

W 

1 

CO 

S  g 
z  o 

(0 

S  g 
z  o 

1 

CO 

50 

z  o 

CO 

5 

Z  O 

1 

CO 

5CN 
Z  G 

1 

CO 

5  CO 
z  o 

1 

CO 

,  5  ^ 
;  z  c 

CO 

5  u> 

Z  O 

CO 

5  CD 

z  o 

1 

CO 

5r- 
z  o 

CO 

5  00 
z  5 

1 

CO 

5  cx 
z  c 

CO 

>18 
1  Z  G 

1 

CO 

is 

A-8 


Verlficatton  Method*:  T  =  Test,  D  =  Demonstraflon,  A  »  Analysis,  I » Inspection,  X  -  Not  Applicable,  *  -  Test  using  Canned  Data,  **  =  The  Reliability  Demonstratton 
shaH  use  reNablHty  data  collected  during  testtng  and  shall  Include  a  72-hour  “hands-ofT  demonsfraOon  test, »  OT&E  Includes  Integradon,  Operational,  and 
Shakedown  lesdng 
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Verification  Methods:  T  «  Test,  D  =  Demonstration,  A  «  Analysis,  I «  Inspection,  X  »  Not  Applicable,  *  «  Test  using  Canned  Data,  **  »  The  Reliability  Demonstration 
shall  use  reliability  data  collected  during  testing  and  shall  Include  a  724iour  “hands-off”  demonstration  test,  #  OT&E  Includes  Int^ration,  Operational,  and 
Shakedown  testing 
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Verfffcatlon  Methods:  T  «  Test,  D  =  Demonstration,  A  «  Analysis,  I »  Inspection,  X  »  Not  Applicable,  *  «  Test  using  Canned  Data,  **  «  The  Reliability  Demonstration 
shall  use  reliability  data  collected  during  testing  and  shall  Include  a  72-hour  ‘'hands-off”  demonstration  test,  #  OT&E  includes  Int^ratlon,  Operational,  and 
Shakedown  testing 


Appendix  B 
Integrated  Schedule 

(WSP  Test  Schedule  in  separate  Microsoft  Project  file) 
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Contractor  Site  Engineering  Reports  Complete  Id  12/18/97  12/18/97  ^12/18 
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ASR-WSP  FAA  TECHNICAL  CENTER  fechnot797 
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ASR-WSP  FAA  TECHNICAL  CENTER 
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ASR-WSP  FAA  TECHNICAL  CENTER  technot797 


208  PAT&E  SAT  Report  {PAT&ESAT+15&15DARC)D1  32d  7/6/99  8/18/99 

209  Contractor  Acceptance  Inspection  (CAI)  1  d  6/1 8/99  6/1 8/99 


WEATHER  SYSTEMS  PROCESSOR  (WSP)  MASTER  TEST  SCHEDULE  -  6/12/97 

This  is  a  projected  test  schedule  and  is  subject  to  change  in  accordance  with  the  WSP  Acquisition  Schedule 

ID  Task  Name _ Duration  Start _ Finish _ 1995 _  1996  |  1997  |  1998  1999 

210  LRU  Bar  Code  Identification  Report  (NLT  24hrs.  after  t  1d  6/21/99  6/21/99  !  |  j  ^  !  WT 
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ASR-WSP  FAA  TECHNICAL  CENTER 


